-- Logs begin at Fri 2022-05-13 14:10:33 UTC, end at Fri 2022-05-13 15:20:39 UTC. -- May 13 14:45:00.310311 dv-cinder-830901-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 14:45:00.318753 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 14:45:00.321308 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 14:45:00 2022] *** May 13 14:45:00.321308 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 14:45:00.321308 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 14:45:00.321308 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: nodename: dv-cinder-830901-6-iscsi May 13 14:45:00.321308 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: machine: x86_64 May 13 14:45:00.321308 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: clock source: unix May 13 14:45:00.321308 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: pcre jit disabled May 13 14:45:00.321308 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: detected number of CPU cores: 4 May 13 14:45:00.321308 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: current working directory: / May 13 14:45:00.321308 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: detected binary path: /usr/bin/uwsgi-core May 13 14:45:00.321308 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: your processes number limit is 47680 May 13 14:45:00.321308 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: your memory page size is 4096 bytes May 13 14:45:00.321308 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: detected max file descriptor number: 2048 May 13 14:45:00.321308 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: lock engine: pthread robust mutexes May 13 14:45:00.322620 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: thunder lock: enabled May 13 14:45:00.322620 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 14:45:00.322620 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 14:45:00.365606 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: Python main interpreter initialized at 0x556f65cdc9c0 May 13 14:45:00.365606 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: python threads support enabled May 13 14:45:00.365606 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: your server socket listen backlog is limited to 100 connections May 13 14:45:00.365606 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: your mercy for graceful operations on workers is 90 seconds May 13 14:45:00.365990 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: mapped 403077 bytes (393 KB) for 2 cores May 13 14:45:00.365990 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: *** Operational MODE: preforking *** May 13 14:45:00.366271 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: *** uWSGI is running in multiple interpreter mode *** May 13 14:45:00.366271 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: spawned uWSGI master process (pid: 102959) May 13 14:45:00.366472 dv-cinder-830901-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 14:45:00.366965 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: spawned uWSGI worker 1 (pid: 102962, cores: 1) May 13 14:45:00.367395 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: spawned uWSGI worker 2 (pid: 102963, cores: 1) May 13 14:45:00.367497 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 14:45:01.568557 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 14:45:01.573960 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 14:45:02.290604 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 14:45:02.290604 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: from cryptography.utils import int_from_bytes May 13 14:45:02.290925 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 14:45:02.290925 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: from cryptography.utils import int_from_bytes May 13 14:45:02.300188 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 14:45:02.300188 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: from cryptography.utils import int_from_bytes May 13 14:45:02.300679 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 14:45:02.300679 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: from cryptography.utils import int_from_bytes May 13 14:45:04.873530 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 14:45:04.874195 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 14:45:04.874195 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 14:45:04.874560 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 14:45:04.874672 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 14:45:04.875025 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 14:45:04.875105 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 14:45:04.875192 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.875343 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 14:45:04.875535 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.875721 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 14:45:04.875818 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.876037 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 14:45:04.876207 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.876366 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.876465 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.876700 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.876797 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.877111 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.877218 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.877289 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.877365 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.877612 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.877740 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.877845 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.877924 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.878271 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.878373 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.878612 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.878815 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830901-6-iscsi {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.879031 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.879110 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.879188 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.879348 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.879462 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.879658 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.879758 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830901-6-iscsi {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.879998 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.880139 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.880444 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.880552 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.880639 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.880718 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.880906 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.881000 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.881270 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.881393 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.881594 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.881827 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.881923 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.882131 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.882379 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.882517 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.882692 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.882820 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.883010 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.883190 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.883293 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.883375 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.883624 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.883723 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.883934 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.884038 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.884249 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.884356 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.884570 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.884675 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.884861 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.884966 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830901-6-iscsi {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.885180 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.885269 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.885489 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.885595 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.885827 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.885925 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830901-6-iscsi {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.886184 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.886282 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.886495 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.886591 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.886811 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.886978 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.887282 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.887379 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.887449 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.887523 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.887717 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.887937 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.888085 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.888175 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.888443 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.888543 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.888667 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.888755 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.888983 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.889113 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.889281 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.889388 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.889576 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.889672 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.889890 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.890005 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.890207 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.890419 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.890519 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.890600 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.890776 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.890917 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.891045 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.891149 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.891462 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.891553 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.891622 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.891695 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.891940 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.892081 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.892373 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.892476 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.892545 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.892611 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.892779 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.892924 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.893063 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.893176 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.893339 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.893430 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.893789 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.894079 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.894284 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.894462 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.894546 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.894667 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.894667 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.894877 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.894979 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.895156 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.895255 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.895345 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.895464 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.895594 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.896041 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.896188 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.896297 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.896434 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.896543 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.896664 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.896769 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.896882 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.896999 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.897096 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.897301 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.897501 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.897594 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.897718 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.99 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.897879 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.898011 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.99 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.898226 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.898433 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.898554 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.898636 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.99 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.898897 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.99 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.899125 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.899243 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.899316 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.899614 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.899732 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.899848 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.899996 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.900157 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.900283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.900404 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.900498 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.900684 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.900828 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.900987 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.901105 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.901298 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.901451 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.901580 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.901653 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.901953 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.902107 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.902273 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.902403 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.902522 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.902611 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.902679 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.902744 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.902977 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.903188 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.903330 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.903441 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.903552 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.903653 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.903803 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.903944 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.904143 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.904267 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.904443 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.904541 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.904740 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.904843 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.905039 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.905163 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.905407 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.905560 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.905686 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.905780 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.906110 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.906283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.906431 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.906542 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.906646 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.906779 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.906779 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.906991 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.907084 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.907198 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.907365 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.907490 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.907657 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.907751 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.907978 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.908124 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.908276 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.908364 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.908649 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.908790 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.908873 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.908967 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.909342 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.909842 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.909842 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.909991 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.909991 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.910122 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.910259 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.910392 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.910561 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.910883 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.911023 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.911134 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.911243 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.911317 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.911556 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.911656 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.911769 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.911952 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.912132 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.912261 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.912348 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.912580 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.912666 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.912883 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.912979 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.913187 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.913273 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.913481 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.913573 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.913778 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.913878 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.914075 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.914170 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.914371 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.914457 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.914667 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.914761 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.914961 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.915047 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.915260 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.915344 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.915559 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.915646 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.915859 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.915983 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.916177 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.916272 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.916476 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.916561 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.916788 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.916882 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.917095 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.917187 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.917400 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.917487 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.917703 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.917801 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.918021 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:45:04.918116 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.918355 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.918449 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.918679 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.918811 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.918991 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.919091 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.919299 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.919385 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.919607 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.919700 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.919951 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.920055 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.920263 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.920350 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.920567 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.920660 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.920871 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.920958 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.921187 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.921273 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.921499 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.921585 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.921810 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.921897 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.922121 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.922228 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.922430 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.922515 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.922743 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.922837 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.923047 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.923133 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.923358 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.923444 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.923675 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.923761 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.924016 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.924117 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.924322 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.924407 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.924636 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.924729 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.925319 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.925434 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.925570 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.925697 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.925790 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.925871 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.926077 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.926190 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.926385 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.926498 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.926691 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.926806 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.926995 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.927137 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.927311 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.927411 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.927627 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.927711 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.927956 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.928054 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.928266 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.928369 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.928570 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.928662 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.928877 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.928972 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.929182 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.929283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.929487 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.929574 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.929790 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.929890 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.930111 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.930206 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.930423 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.930510 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.930730 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.930849 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.931037 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.931125 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.931348 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.931437 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.931654 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.931741 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.931979 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.932088 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.932294 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.932394 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.932580 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.932668 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.932879 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.932972 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.933177 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.933273 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.933481 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.933575 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.933777 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.933864 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.934079 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.934165 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.934385 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.934475 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.934688 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.934784 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.934988 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.935147 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.935300 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.935407 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.935604 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.935692 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.935925 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.936015 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.936232 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.936337 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.936534 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.936620 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.936837 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.936924 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.937140 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.937239 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.937440 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.937526 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.937741 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.937827 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.938042 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.938135 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.938341 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.938427 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.938642 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.938733 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.938943 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.939028 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.939243 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.939330 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.939550 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.939636 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.939854 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.939971 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.940181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.940267 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.940531 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.940817 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.940817 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.941295 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.941376 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.941462 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.941549 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.941638 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.941726 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.941805 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.942023 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.942109 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.942342 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.942437 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.942639 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.942725 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.942952 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.943037 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.943268 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.943361 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.943579 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.943665 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.943894 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.943997 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.944201 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.944297 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.944498 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.944586 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.944798 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.944884 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.945097 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.945193 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.945400 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.945487 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.945699 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.945786 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.945997 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.946088 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.946294 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.946381 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.946593 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.946680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.946890 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.946986 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.947193 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.947281 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.947495 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.947589 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.947794 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.947908 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.948114 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.948204 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.948410 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.948497 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.948724 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.948816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.949028 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.949113 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.949330 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.949425 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.949639 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.949725 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.949972 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.950057 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.950275 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.950369 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.950582 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.950667 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.950892 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.950982 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.951197 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.951291 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.951816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.951934 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.952146 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.952234 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.952453 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.952549 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.952770 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.952855 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.953071 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.953157 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.953378 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.953471 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.953681 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.953773 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.953996 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.954091 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.954299 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.954392 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.954613 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.954700 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.954911 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.955005 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.955218 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.955306 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.955526 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.955612 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.955846 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.956030 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.956242 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.956706 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.956792 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.956872 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.956950 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.957027 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.957119 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.957243 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.957384 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.957558 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.957687 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.957882 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.957991 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.958191 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.958279 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.958505 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.958594 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.958815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.958903 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.959125 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.959206 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.959438 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.959526 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.959749 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.959837 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.960083 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.960188 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.960390 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.960477 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.960688 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.960783 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.960997 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.961084 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.961316 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.961410 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.961625 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.961712 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.961927 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.962014 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.962230 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.962324 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.962541 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.962640 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.962841 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.962927 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.963146 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.963309 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.963448 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.963536 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.963744 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.963838 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.964064 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.964166 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.964367 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.964455 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.964673 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.964760 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.964976 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.965065 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.965275 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.965361 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.965571 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.965656 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.965874 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.965960 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.966174 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.966260 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.966470 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.966558 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.966767 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.966853 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.967069 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.967155 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.967381 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.967465 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.967680 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.967775 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.968002 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.968095 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.968305 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.968410 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.968602 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.968689 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.968896 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.968984 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.969211 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.969354 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.969511 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.969612 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.969805 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.969892 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.970103 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.970203 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.970395 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.970483 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.970714 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.970808 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.971015 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.971109 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.971310 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.971398 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.971607 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.971841 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.972077 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.972521 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.972621 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.972702 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.972849 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.972938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.973164 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.973253 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.973471 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.973558 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.973774 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.973867 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.974074 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.974162 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.974376 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.974513 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.974677 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.974765 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.974980 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.975075 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.975283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.975378 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.975591 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.975677 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.975938 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.976068 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.976235 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.976324 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.976534 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.976641 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.976831 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.976918 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.977131 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.977226 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.977436 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.977531 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.977758 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.978006 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.978092 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.978331 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.978424 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.978639 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.978727 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.978939 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.979024 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.979246 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.979333 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.979555 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.979641 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.979906 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.980160 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.980259 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.980495 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.980583 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.980813 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.980916 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.981112 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.981208 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.981412 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.981508 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.981713 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.981800 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.982016 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.982103 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.982315 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.982411 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.982613 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.982699 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.982909 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.983005 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.983212 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.983305 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.983508 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.983602 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.983805 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.983924 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.984125 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.984212 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.984422 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.984509 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.984730 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.984817 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.985025 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.985113 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.985326 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.985414 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.985623 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.985717 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.985936 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.986023 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.986243 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.986378 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.986526 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.986615 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.986821 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.986986 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.987113 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.987202 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.987512 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.987771 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.988219 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.988326 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.988411 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.988500 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.988594 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.988682 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.988763 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.988969 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.989058 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.989272 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.989360 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.989580 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.989677 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.989898 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.989983 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.990198 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.990294 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.990493 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.990589 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.990793 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.990883 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.991091 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.991185 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.991387 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.991488 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.991687 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.991775 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.992009 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.992131 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.992312 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.992435 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.992610 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.992741 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.992902 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.993043 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.993200 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.993348 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.993491 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.993653 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.993794 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.993955 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.994099 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.994262 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.994393 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.994569 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.994687 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.994876 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.994971 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.995184 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.995271 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.995485 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.995582 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.995791 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.995916 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.996119 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.996207 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.996431 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.996566 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.996725 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.996812 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.997019 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.997106 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.997316 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.997403 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.997615 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.997703 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.997913 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.998001 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.998207 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.998301 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.998510 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.998597 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.998809 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.998895 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.999103 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.999190 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.999397 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.999486 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.999696 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:04.999781 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.000016 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.000124 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.000312 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.000399 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.000612 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.000700 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.000909 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.001004 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.001219 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.001305 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.001517 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.001604 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.001815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.001909 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.002108 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.002194 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.002403 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.002490 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.002700 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.002796 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.003045 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.003489 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.003617 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.003704 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.003795 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.003913 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.003997 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.004238 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.004369 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.004533 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.004679 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.004840 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.004986 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.005109 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.005203 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.005434 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.005586 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.005702 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.005804 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.006024 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.006156 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.006322 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.006467 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.006613 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.006704 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.006914 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.007048 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.007193 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.007301 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.007525 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.007666 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.007848 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.008019 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.008122 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.008213 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.008464 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.008606 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.008770 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.008905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.009039 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.009139 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.009351 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.009450 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.009649 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.009790 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.009959 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.010049 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.010255 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.010345 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.010549 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.010640 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.010859 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.010949 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.011163 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.011262 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.011462 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.011560 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.011778 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.011930 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.012099 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.012190 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.012416 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.012525 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.012714 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.012803 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.013024 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.013121 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.013324 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.013421 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.013620 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.013708 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.013925 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.014014 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.014221 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.014320 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.014528 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.014623 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.014823 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.014919 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.015140 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.015239 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.015418 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.015504 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.015730 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.015816 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.016054 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.016142 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.016359 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.016458 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.016661 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.016753 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.016955 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.017041 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.017259 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.017351 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.017561 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.017646 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.017858 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.017944 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.018157 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.018242 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.018452 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.018561 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.018775 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.019140 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.019238 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.019387 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.019497 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.019704 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.019843 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.020043 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.020130 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.020358 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.020444 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.020685 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.020772 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.020988 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.021079 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.021290 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.021374 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.021594 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.021680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.021892 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.021976 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.022203 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.022300 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.022507 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.022593 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.022887 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.022971 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.023188 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.023282 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.023484 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.023578 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.023778 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.023902 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.024102 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.024212 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.024424 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.024511 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.024721 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.024824 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.025017 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.025113 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.025312 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.025399 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.025625 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.025748 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.025919 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.026060 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.026234 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.026372 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.026636 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.026723 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.026937 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.027023 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.027235 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.027369 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.027566 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.027659 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.027907 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.028035 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.028216 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.028304 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.028522 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.028608 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.028826 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.028912 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.029138 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.029227 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.029435 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.029528 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.029743 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.029830 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.030042 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.030161 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.030363 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.030463 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.030674 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.030760 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.030981 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.031157 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.031271 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.031466 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.031554 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.031776 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.031863 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.032130 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.032274 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.032449 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.032580 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.032771 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.032892 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.033076 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.033306 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.033392 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.033617 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.033712 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.033918 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.034004 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.034310 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.034561 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.034656 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.034737 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.034894 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.035039 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.035189 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.035348 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.035489 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.035672 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.035785 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.036016 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.036120 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.036333 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.036428 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.036655 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.036749 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.036973 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.037059 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.037274 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.037373 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.037572 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.037658 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.037865 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.037972 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.038162 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.038295 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.038472 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.038603 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.038767 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.038906 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.039096 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.039212 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.039400 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.039515 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.039719 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.039811 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.040054 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.040143 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.040351 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.040437 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.040664 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.040749 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.040965 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.041052 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.041259 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.041351 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.041555 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.041650 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.041850 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.041936 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.042178 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.042264 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.042475 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.042574 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.042785 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.042871 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.043105 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.043191 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.043423 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.043515 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.043741 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.043834 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.044069 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.044157 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.044390 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.044486 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.044698 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.044784 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.045000 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.045085 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.045306 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.045393 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.045605 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.045689 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.045903 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.045989 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.046204 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.046292 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.046499 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.046597 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.046795 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.046882 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.047092 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.047183 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.047391 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.047477 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.047687 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.047788 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.048004 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.048149 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.048301 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.048410 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.048612 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.048728 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.048908 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.049048 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.049217 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.049352 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.049523 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.049657 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.049841 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.050140 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.050224 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.050434 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.050519 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.050759 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.050845 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.051051 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.051143 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.051356 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.051442 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.051662 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.051749 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.051992 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.052083 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.052297 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.052395 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.052600 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.052685 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.052908 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.052993 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.053215 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.053307 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.053519 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.053603 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.053824 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.053908 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.054125 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.054256 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.054426 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.054514 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.054730 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.054814 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.055037 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.055131 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.055339 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.055432 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.055648 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.055733 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.055981 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.056070 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.056294 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.056380 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.056602 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.056811 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.056908 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.057131 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.057218 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.057438 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.057525 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.057744 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.057838 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.058048 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.058134 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.058355 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.058449 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.058659 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.058753 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.058963 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.059049 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.059267 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.059352 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.059576 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.059663 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.059912 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.060016 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.060220 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.060306 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.060537 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.060739 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.060857 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.061067 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.061183 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.061380 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.061544 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.061690 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.061777 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.062000 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.062087 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.062310 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.062397 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.062619 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.062705 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.062925 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.063018 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.063233 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.063320 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.063542 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.063629 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.063849 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.063969 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.064197 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.064284 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.064498 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.064583 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.064803 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.064901 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.065110 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.065195 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.065457 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.065555 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.065765 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.065949 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.066081 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.066268 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.066362 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.066583 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.066683 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.066950 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.067047 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.067268 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.067354 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.067576 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.067671 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.067895 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.068039 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.068208 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.068294 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.068516 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.068681 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.068823 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.069040 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.069125 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.069355 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.069449 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.069689 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.069780 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.070011 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.070096 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.070324 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.070421 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.070635 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.070719 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.070945 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.071030 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.071266 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.071359 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.071573 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.071665 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.071890 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.071979 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.072203 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.072291 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.072506 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.072591 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.072804 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.072889 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.073119 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.073330 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.073416 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.073652 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.073750 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.073991 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.074085 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.074294 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.074379 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.074634 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.074815 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.074954 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.075158 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.075275 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.075467 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.075606 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.075786 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.075937 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.076138 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.076236 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.076765 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.076853 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.077068 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.077162 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.077383 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.077476 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.077683 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.077768 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.077982 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.078081 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.078290 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.078384 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.078594 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.078681 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.078893 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.078987 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.079191 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.079443 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.079530 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.079792 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.079946 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.080119 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.080213 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.080422 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.080509 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.080717 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.080813 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.081065 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.081221 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.081363 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.081452 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.081682 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.081776 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.081989 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.082082 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.082293 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.082379 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.082609 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.082702 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.082908 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.083001 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.083206 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.083293 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.083503 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.083591 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.083805 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.083923 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.084126 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.084213 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.084429 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.084524 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.084726 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.084812 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.085026 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.085120 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.085323 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.085410 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.085624 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.085710 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.085925 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.086010 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.086228 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.086315 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.086536 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.086622 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.086831 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.086924 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.087135 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.087220 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.087433 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.087518 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.087733 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.087830 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.088061 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.088149 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.088359 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.088451 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.088667 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.088762 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.088969 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.089065 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.089278 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.089503 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.089597 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.089841 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.089979 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.090145 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.090234 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.090471 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.090608 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.090797 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.090884 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.091100 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.091193 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.091396 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.091489 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.091696 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.091782 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.092038 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.092126 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.092342 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.092440 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.092647 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.092733 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.092949 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.093037 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.093252 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.093348 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.093554 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.093806 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.093893 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.094140 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.094235 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.094438 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.094524 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.094737 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.094823 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.095038 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.095133 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.095338 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.095425 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.095639 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.095728 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.095968 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.096072 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.096296 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.096382 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.096605 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.096748 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.096962 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.097076 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.097271 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.097395 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.097580 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.097708 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.097870 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.098015 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.098179 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.098321 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.098485 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.098625 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.098792 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.098941 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.099097 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.099252 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.099405 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.099581 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.099716 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.099915 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.100048 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.100220 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.100360 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.100630 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.100718 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.100936 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.101021 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.101248 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.101335 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.101564 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.101657 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.101867 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.101961 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.102183 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.102281 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.102501 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.102596 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.102804 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.102891 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.103110 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.103203 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.103411 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.103496 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.103735 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.103821 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.104073 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.104185 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.104382 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.104468 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.104706 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.104790 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.105006 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.105094 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.105307 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.105399 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.105609 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.105695 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.105911 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.105997 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.106223 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.106310 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.106526 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.106613 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.106825 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.106911 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.107122 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.107215 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.107421 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.107508 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.107720 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.107806 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.108042 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.108179 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.108340 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.108509 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.108638 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.108832 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.108939 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.109138 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.109231 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.109447 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.109535 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.109751 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.109837 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.110058 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.110145 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.110371 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.110463 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.110667 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.110803 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.110966 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.111060 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.111260 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.111350 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.111556 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.111642 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.111849 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.112000 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.112164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.112269 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.112486 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.112608 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.112810 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.112905 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.113135 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.113222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.113444 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.113536 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.113756 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.113855 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.114056 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.114142 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.114368 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.114455 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.114668 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.114755 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.114971 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.115056 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.115280 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.115366 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.115583 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.115670 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.115893 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.115981 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.116202 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.116287 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.116504 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.116592 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.116805 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.116889 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.117107 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.117192 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.117410 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.117505 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.117711 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.117835 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.118012 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.118112 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.118328 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.118415 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.118644 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.118738 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.118946 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.119040 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.119265 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.119351 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.119578 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.119665 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.119905 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.120009 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.120218 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.120305 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.120519 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.120603 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.120840 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.120934 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.121147 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.121233 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.121446 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.121532 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.121753 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.121839 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.122052 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.122136 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.122353 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.122439 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.122658 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.122745 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.122967 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.123061 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.123275 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.123359 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.123641 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.123734 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.123913 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.124001 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.124238 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.124336 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.124554 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.124642 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.124864 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.124961 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.125183 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.125281 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.125490 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.125575 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.125798 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.125886 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.126111 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.126269 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.126411 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.126504 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.126709 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.126801 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.126946 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102962) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 14:45:05.127034 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.127324 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.127652 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.128333 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.128652 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.128981 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.129308 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.129660 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.129975 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.130316 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.130644 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.130960 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.131270 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.131575 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:45:05.131818 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102963) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 14:45:05.150574 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG oslo_db.sqlalchemy.engines [None req-9a95185e-7d94-457c-935b-d4c9ecfa3d5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102962) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:45:05.154491 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_db.sqlalchemy.engines [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:45:05.214110 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.context [None req-9a95185e-7d94-457c-935b-d4c9ecfa3d5b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f561f54-7711-4fce-bd48-81b057a05d37(cell1) {{(pid=102962) load_cells /opt/stack/nova/nova/context.py:464}} May 13 14:45:05.216609 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.context [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f561f54-7711-4fce-bd48-81b057a05d37(cell1) {{(pid=102963) load_cells /opt/stack/nova/nova/context.py:464}} May 13 14:45:05.218569 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG oslo_concurrency.lockutils [None req-9a95185e-7d94-457c-935b-d4c9ecfa3d5b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:45:05.220231 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG oslo_concurrency.lockutils [None req-9a95185e-7d94-457c-935b-d4c9ecfa3d5b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:45:05.221008 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:45:05.221143 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG oslo_concurrency.lockutils [None req-9a95185e-7d94-457c-935b-d4c9ecfa3d5b None None] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:45:05.222968 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:45:05.223116 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG oslo_concurrency.lockutils [None req-9a95185e-7d94-457c-935b-d4c9ecfa3d5b None None] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102962) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:45:05.223761 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:45:05.225723 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:45:05.237394 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG oslo_db.sqlalchemy.engines [None req-9a95185e-7d94-457c-935b-d4c9ecfa3d5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102962) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:45:05.239260 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_db.sqlalchemy.engines [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:45:05.243415 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG oslo_db.sqlalchemy.engines [None req-9a95185e-7d94-457c-935b-d4c9ecfa3d5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102962) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:45:05.246684 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_db.sqlalchemy.engines [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:45:05.406101 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG oslo_db.sqlalchemy.engines [None req-9a95185e-7d94-457c-935b-d4c9ecfa3d5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102962) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:45:05.409791 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_db.sqlalchemy.engines [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102963) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:45:05.744102 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: WARNING keystonemiddleware.auth_token [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 14:45:05.747389 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: WARNING keystonemiddleware.auth_token [None req-9a95185e-7d94-457c-935b-d4c9ecfa3d5b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 14:45:05.751468 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: WARNING keystonemiddleware.auth_token [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 14:45:05.754967 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: WARNING keystonemiddleware.auth_token [None req-9a95185e-7d94-457c-935b-d4c9ecfa3d5b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 14:45:06.096962 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: WARNING keystonemiddleware.auth_token [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 14:45:06.101376 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: WARNING keystonemiddleware.auth_token [None req-9a95185e-7d94-457c-935b-d4c9ecfa3d5b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 14:45:06.103007 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: WARNING keystonemiddleware.auth_token [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 14:45:06.107479 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: WARNING keystonemiddleware.auth_token [None req-9a95185e-7d94-457c-935b-d4c9ecfa3d5b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 14:45:06.109061 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556f65cdc9c0 pid: 102963 (default app) May 13 14:45:06.111180 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:45:06.112448 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] 10.222.0.99 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001764 May 13 14:45:06.113205 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 1/1] 10.222.0.99 () {50 vars in 788 bytes} [Fri May 13 14:45:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:45:06.113763 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556f65cdc9c0 pid: 102962 (default app) May 13 14:46:25.262200 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:46:25.263201 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 13 14:46:25.263576 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 2/2] 10.222.0.99 () {54 vars in 930 bytes} [Fri May 13 14:46:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:46:25.676970 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-a9a0b1ca-a665-46fb-84db-77e83731dc1f admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:46:25.706588 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-a9a0b1ca-a665-46fb-84db-77e83731dc1f admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.436087 May 13 14:46:25.707714 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 1/3] 10.222.0.99 () {60 vars in 1291 bytes} [Fri May 13 14:46:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:46:27.965967 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:46:27.966956 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-874f328e-a8aa-4500-8bcf-8de9ec25edba None None] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 May 13 14:46:27.967449 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 3/4] 10.222.0.99 () {54 vars in 930 bytes} [Fri May 13 14:46:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:46:28.031444 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-d4921791-28a8-4326-b4fe-b09268f225ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:28.050043 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 14:46:28.050043 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: warnings.warn(msg) May 13 14:46:28.078811 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-d4921791-28a8-4326-b4fe-b09268f225ea admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105278 May 13 14:46:28.086274 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 2/5] 10.222.0.99 () {64 vars in 1282 bytes} [Fri May 13 14:46:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:46:28.301294 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-dff85ec3-ff16-4be9-a9dc-79f0f4b42c87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:28.304499 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 14:46:28.304499 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: warnings.warn(msg) May 13 14:46:28.364455 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-dff85ec3-ff16-4be9-a9dc-79f0f4b42c87 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.276691 May 13 14:46:28.365037 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 4/6] 10.222.0.99 () {64 vars in 1335 bytes} [Fri May 13 14:46:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:46:30.643910 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-d4921791-28a8-4326-b4fe-b09268f225ea admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:46:30.643910 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-d4921791-28a8-4326-b4fe-b09268f225ea admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 May 13 14:46:30.643910 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 3/7] 10.222.0.99 () {54 vars in 930 bytes} [Fri May 13 14:46:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:46:30.768591 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-c727ee4d-5d4e-4b1e-862e-b45e6f82fd06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "ram": 512, "id": "d1"}} {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:30.786670 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 14:46:30.786670 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: warnings.warn(msg) May 13 14:46:30.807422 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-c727ee4d-5d4e-4b1e-862e-b45e6f82fd06 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153708 May 13 14:46:30.808054 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 5/8] 10.222.0.99 () {64 vars in 1282 bytes} [Fri May 13 14:46:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:46:30.820677 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-2b08739a-5e00-4f55-8fe7-942dfceccb27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:30.822378 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 14:46:30.822378 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: warnings.warn(msg) May 13 14:46:30.854978 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-2b08739a-5e00-4f55-8fe7-942dfceccb27 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038299 May 13 14:46:30.855573 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 4/9] 10.222.0.99 () {64 vars in 1335 bytes} [Fri May 13 14:46:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:46:33.141382 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-c727ee4d-5d4e-4b1e-862e-b45e6f82fd06 admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:46:33.142396 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-c727ee4d-5d4e-4b1e-862e-b45e6f82fd06 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 May 13 14:46:33.142971 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 6/10] 10.222.0.99 () {54 vars in 930 bytes} [Fri May 13 14:46:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:46:33.200206 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-f9c0691d-db28-4259-8731-3be18e962878 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "rxtx_factor": 1.0, "id": "d2", "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "name": "ds1G"}} {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:33.220181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-f9c0691d-db28-4259-8731-3be18e962878 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071471 May 13 14:46:33.220909 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 5/11] 10.222.0.99 () {64 vars in 1282 bytes} [Fri May 13 14:46:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 14:46:33.232823 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-10f452d0-0a2a-405e-bbe6-d8414dd881df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:33.260441 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-10f452d0-0a2a-405e-bbe6-d8414dd881df admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031440 May 13 14:46:33.272111 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 7/12] 10.222.0.99 () {64 vars in 1335 bytes} [Fri May 13 14:46:33 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:46:35.574119 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-f9c0691d-db28-4259-8731-3be18e962878 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:46:35.575046 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-f9c0691d-db28-4259-8731-3be18e962878 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 May 13 14:46:35.575461 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 6/13] 10.222.0.99 () {54 vars in 930 bytes} [Fri May 13 14:46:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:46:35.641504 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-bf048ef7-9f18-4c52-b333-5d12bf9dcacf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:35.662558 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-bf048ef7-9f18-4c52-b333-5d12bf9dcacf admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080474 May 13 14:46:35.663127 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 8/14] 10.222.0.99 () {64 vars in 1282 bytes} [Fri May 13 14:46:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 14:46:35.675622 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-4edcd353-3702-4f9d-a12e-545f82cca60f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:35.701333 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-4edcd353-3702-4f9d-a12e-545f82cca60f admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029408 May 13 14:46:35.702157 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 7/15] 10.222.0.99 () {64 vars in 1335 bytes} [Fri May 13 14:46:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:46:37.983654 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-bf048ef7-9f18-4c52-b333-5d12bf9dcacf admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:46:37.984711 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-bf048ef7-9f18-4c52-b333-5d12bf9dcacf admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 May 13 14:46:37.985116 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 9/16] 10.222.0.99 () {54 vars in 930 bytes} [Fri May 13 14:46:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:46:38.046409 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-026ce0b9-2a8b-42f2-912f-4f0f68ed37c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "ds4G", "id": "d4"}} {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:38.066909 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-026ce0b9-2a8b-42f2-912f-4f0f68ed37c4 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075699 May 13 14:46:38.071962 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 8/17] 10.222.0.99 () {64 vars in 1282 bytes} [Fri May 13 14:46:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:46:38.080124 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-25e4a71a-5fe1-430b-a255-c7ce0fb79cc1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:38.105495 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-25e4a71a-5fe1-430b-a255-c7ce0fb79cc1 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029675 May 13 14:46:38.106115 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 10/18] 10.222.0.99 () {64 vars in 1335 bytes} [Fri May 13 14:46:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:46:40.343276 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-026ce0b9-2a8b-42f2-912f-4f0f68ed37c4 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:46:40.344391 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-026ce0b9-2a8b-42f2-912f-4f0f68ed37c4 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 May 13 14:46:40.344766 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 9/19] 10.222.0.99 () {54 vars in 930 bytes} [Fri May 13 14:46:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:46:40.419621 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-29d4df72-ae92-461c-a677-21c76b010d48 admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:46:40.444944 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-29d4df72-ae92-461c-a677-21c76b010d48 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086664 May 13 14:46:40.445874 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 11/20] 10.222.0.99 () {60 vars in 1291 bytes} [Fri May 13 14:46:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:46:42.929101 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-026ce0b9-2a8b-42f2-912f-4f0f68ed37c4 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:46:42.930119 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-026ce0b9-2a8b-42f2-912f-4f0f68ed37c4 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 13 14:46:42.930521 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 10/21] 10.222.0.99 () {54 vars in 930 bytes} [Fri May 13 14:46:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:46:42.992101 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-74d89e90-3073-426e-bbf7-916ae476f56b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "id": "1"}} {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:43.015247 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-74d89e90-3073-426e-bbf7-916ae476f56b admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078394 May 13 14:46:43.016981 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 12/22] 10.222.0.99 () {64 vars in 1282 bytes} [Fri May 13 14:46:42 2022] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:46:43.031172 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-07e30c61-d905-4e51-a33c-52258cafb857 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:43.056761 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-07e30c61-d905-4e51-a33c-52258cafb857 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031413 May 13 14:46:43.057331 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 11/23] 10.222.0.99 () {64 vars in 1332 bytes} [Fri May 13 14:46:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:46:45.305818 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-74d89e90-3073-426e-bbf7-916ae476f56b admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:46:45.307136 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-74d89e90-3073-426e-bbf7-916ae476f56b admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001933 May 13 14:46:45.307696 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 13/24] 10.222.0.99 () {54 vars in 930 bytes} [Fri May 13 14:46:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:46:45.370609 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-e4736166-1c08-463c-9d89-13db518ccbcf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:45.388827 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-e4736166-1c08-463c-9d89-13db518ccbcf admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074276 May 13 14:46:45.389385 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 12/25] 10.222.0.99 () {64 vars in 1282 bytes} [Fri May 13 14:46:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:46:45.402616 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-a4f702b2-592c-45f0-b71c-1b7cb6ea8fd4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:45.431548 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-a4f702b2-592c-45f0-b71c-1b7cb6ea8fd4 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033821 May 13 14:46:45.432634 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 14/26] 10.222.0.99 () {64 vars in 1332 bytes} [Fri May 13 14:46:45 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:46:47.667195 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-e4736166-1c08-463c-9d89-13db518ccbcf admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:46:47.668498 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-e4736166-1c08-463c-9d89-13db518ccbcf admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 May 13 14:46:47.669274 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 13/27] 10.222.0.99 () {54 vars in 930 bytes} [Fri May 13 14:46:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:46:47.728753 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-917c85c4-6001-48a5-be35-a0fd6cfaa49c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "rxtx_factor": 1.0}} {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:47.748572 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-917c85c4-6001-48a5-be35-a0fd6cfaa49c admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073574 May 13 14:46:47.749125 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 15/28] 10.222.0.99 () {64 vars in 1282 bytes} [Fri May 13 14:46:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:46:47.760791 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-98dd9ce4-c81d-4d0d-8e49-578bf71ef1fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:47.784130 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-98dd9ce4-c81d-4d0d-8e49-578bf71ef1fd admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026777 May 13 14:46:47.784643 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 14/29] 10.222.0.99 () {64 vars in 1332 bytes} [Fri May 13 14:46:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:46:49.995385 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-917c85c4-6001-48a5-be35-a0fd6cfaa49c admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:46:49.996430 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-917c85c4-6001-48a5-be35-a0fd6cfaa49c admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 13 14:46:49.997045 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 16/30] 10.222.0.99 () {54 vars in 930 bytes} [Fri May 13 14:46:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:46:50.053594 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-906802bb-a590-4353-ad85-451d7706e198 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "disk": 80, "vcpus": 4, "id": "4", "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true}} {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:50.072255 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-906802bb-a590-4353-ad85-451d7706e198 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069816 May 13 14:46:50.072826 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 15/31] 10.222.0.99 () {64 vars in 1282 bytes} [Fri May 13 14:46:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 14:46:50.084811 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-7f57762b-f261-49f9-9ef2-415eedd0a0b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:50.112753 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-7f57762b-f261-49f9-9ef2-415eedd0a0b5 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031856 May 13 14:46:50.113335 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 17/32] 10.222.0.99 () {64 vars in 1332 bytes} [Fri May 13 14:46:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:46:52.427306 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-906802bb-a590-4353-ad85-451d7706e198 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:46:52.428362 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-906802bb-a590-4353-ad85-451d7706e198 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 May 13 14:46:52.428774 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 16/33] 10.222.0.99 () {54 vars in 930 bytes} [Fri May 13 14:46:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:46:52.494728 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-36286ff2-44b2-48ac-b1b9-61bd786fee57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "disk": 160}} {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:52.522806 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-36286ff2-44b2-48ac-b1b9-61bd786fee57 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.088241 May 13 14:46:52.523365 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 18/34] 10.222.0.99 () {64 vars in 1282 bytes} [Fri May 13 14:46:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 14:46:52.543368 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-49edcae8-891c-4a66-bba9-a23017d121b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:46:52.569756 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-49edcae8-891c-4a66-bba9-a23017d121b8 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030554 May 13 14:46:52.570450 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 17/35] 10.222.0.99 () {64 vars in 1332 bytes} [Fri May 13 14:46:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:47:16.529540 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-36286ff2-44b2-48ac-b1b9-61bd786fee57 admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:16.530552 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-36286ff2-44b2-48ac-b1b9-61bd786fee57 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 13 14:47:16.530961 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 19/36] 10.222.0.99 () {54 vars in 930 bytes} [Fri May 13 14:47:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:47:16.608684 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-4cc57e9b-29e0-4fcd-bb6a-f9c0ec48c3ae admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:16.626644 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-4cc57e9b-29e0-4fcd-bb6a-f9c0ec48c3ae admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.089050 May 13 14:47:16.627183 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 18/37] 10.222.0.99 () {60 vars in 1291 bytes} [Fri May 13 14:47:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:47:17.638250 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-36286ff2-44b2-48ac-b1b9-61bd786fee57 admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:17.639244 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-36286ff2-44b2-48ac-b1b9-61bd786fee57 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 13 14:47:17.639632 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 20/38] 10.222.0.99 () {56 vars in 1074 bytes} [Fri May 13 14:47:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:47:17.846235 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-b65e47fe-339f-402f-9fb6-3897a0fb778c admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:17.854688 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.wsgi [None req-b65e47fe-339f-402f-9fb6-3897a0fb778c admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-b65e47fe-339f-402f-9fb6-3897a0fb778c admin admin] Request method failure captured: May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Accept: application/json May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Accept-Encoding: gzip, deflate May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Connection: keep-alive May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Content-Length: 0 May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Host: 10.222.0.99 May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Openstack-Api-Version: compute 2.90 May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Openstack-System-Scope: None May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: User-Agent: python-novaclient May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Auth-Token: gAAAAABifm91r5VDaSHlj8S7Fz5px-rTXnr5g0AubiPCnftlj8XpT7rjCDbjNi1KGcabsm04o7cmh9kM79-lI5ydCxMgY1ubTKju65jN2XiaeKy3p46CQg6Ru5HuiRqQVz-GmwLgqhVrJqXPY2reRcajDANxvJKZQNe-FVBqA_JrvICvW0LysJQ May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Domain-Id: None May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Domain-Name: None May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Identity-Status: Confirmed May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Is-Admin-Project: True May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Openstack-Nova-Api-Version: 2.90 May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Project-Domain-Id: default May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Project-Domain-Name: Default May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Project-Id: 874372a810af4de2a4ad12d67714243a May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Project-Name: admin May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Role: admin,reader,member May 13 14:47:17.859938 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Roles: admin,reader,member May 13 14:47:17.862091 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_874372a810af4de2a4ad12d67714243a", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/874372a810af4de2a4ad12d67714243a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/874372a810af4de2a4ad12d67714243a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/874372a810af4de2a4ad12d67714243a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:47:17.862091 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Tenant: admin May 13 14:47:17.862091 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Tenant-Id: 874372a810af4de2a4ad12d67714243a May 13 14:47:17.862091 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Tenant-Name: admin May 13 14:47:17.862091 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-User: admin May 13 14:47:17.862091 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-User-Domain-Id: default May 13 14:47:17.862091 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-User-Domain-Name: Default May 13 14:47:17.862091 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-User-Id: 3521504b5b0e494782ca07b80f916dd3 May 13 14:47:17.862091 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-User-Name: admin May 13 14:47:17.862091 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: method: > May 13 14:47:17.862091 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: exception: Flavor 42 could not be found. May 13 14:47:17.862091 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: action_args: {'id': '42'} May 13 14:47:17.862091 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:47:17.862091 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:47:17.864432 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi May 13 14:47:17.865584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-b65e47fe-339f-402f-9fb6-3897a0fb778c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:47:17.866654 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-b65e47fe-339f-402f-9fb6-3897a0fb778c admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.082867 May 13 14:47:17.866654 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 19/39] 10.222.0.99 () {60 vars in 1190 bytes} [Fri May 13 14:47:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 14:47:17.871769 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-6ddbd818-763b-4d08-887f-54b1e83c72c7 admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:17.892868 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-6ddbd818-763b-4d08-887f-54b1e83c72c7 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024556 May 13 14:47:17.893448 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 21/40] 10.222.0.99 () {60 vars in 1210 bytes} [Fri May 13 14:47:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:47:17.906169 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-11ec307a-c2c3-4cfa-8d31-158f307efd80 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:17.928302 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-11ec307a-c2c3-4cfa-8d31-158f307efd80 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025800 May 13 14:47:17.928840 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 20/41] 10.222.0.99 () {60 vars in 1210 bytes} [Fri May 13 14:47:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:47:17.938507 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-6f7947dc-78af-4138-b9e3-4b6494f9a093 admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:17.944582 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.wsgi [None req-6f7947dc-78af-4138-b9e3-4b6494f9a093 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-6f7947dc-78af-4138-b9e3-4b6494f9a093 admin admin] Request method failure captured: May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Accept: application/json May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Accept-Encoding: gzip, deflate May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Connection: keep-alive May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Content-Length: 0 May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Host: 10.222.0.99 May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Openstack-Api-Version: compute 2.90 May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Openstack-System-Scope: None May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: User-Agent: python-novaclient May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Auth-Token: gAAAAABifm91r5VDaSHlj8S7Fz5px-rTXnr5g0AubiPCnftlj8XpT7rjCDbjNi1KGcabsm04o7cmh9kM79-lI5ydCxMgY1ubTKju65jN2XiaeKy3p46CQg6Ru5HuiRqQVz-GmwLgqhVrJqXPY2reRcajDANxvJKZQNe-FVBqA_JrvICvW0LysJQ May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Domain-Id: None May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Domain-Name: None May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Identity-Status: Confirmed May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Is-Admin-Project: True May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Openstack-Nova-Api-Version: 2.90 May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Project-Domain-Id: default May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Project-Domain-Name: Default May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Project-Id: 874372a810af4de2a4ad12d67714243a May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Project-Name: admin May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Role: admin,reader,member May 13 14:47:17.947847 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Roles: admin,reader,member May 13 14:47:17.949371 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_874372a810af4de2a4ad12d67714243a", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/874372a810af4de2a4ad12d67714243a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/874372a810af4de2a4ad12d67714243a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/874372a810af4de2a4ad12d67714243a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:47:17.949371 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Tenant: admin May 13 14:47:17.949371 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Tenant-Id: 874372a810af4de2a4ad12d67714243a May 13 14:47:17.949371 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Tenant-Name: admin May 13 14:47:17.949371 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-User: admin May 13 14:47:17.949371 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-User-Domain-Id: default May 13 14:47:17.949371 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-User-Domain-Name: Default May 13 14:47:17.949371 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-User-Id: 3521504b5b0e494782ca07b80f916dd3 May 13 14:47:17.949371 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-User-Name: admin May 13 14:47:17.949371 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: method: > May 13 14:47:17.949371 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: exception: Flavor 42 could not be found. May 13 14:47:17.949371 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: action_args: {'id': '42'} May 13 14:47:17.949371 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:47:17.949371 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:47:17.950251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi May 13 14:47:17.951285 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-6f7947dc-78af-4138-b9e3-4b6494f9a093 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:47:17.952345 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-6f7947dc-78af-4138-b9e3-4b6494f9a093 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014370 May 13 14:47:17.952345 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 22/42] 10.222.0.99 () {60 vars in 1190 bytes} [Fri May 13 14:47:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 14:47:18.844166 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-11ec307a-c2c3-4cfa-8d31-158f307efd80 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:18.845213 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-11ec307a-c2c3-4cfa-8d31-158f307efd80 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 May 13 14:47:18.845605 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 21/43] 10.222.0.99 () {56 vars in 1074 bytes} [Fri May 13 14:47:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:47:19.048650 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-56eba2fb-f92c-49ee-ae70-76d3e7283078 admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:19.055148 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.wsgi [None req-56eba2fb-f92c-49ee-ae70-76d3e7283078 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-56eba2fb-f92c-49ee-ae70-76d3e7283078 admin admin] Request method failure captured: May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Accept: application/json May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Accept-Encoding: gzip, deflate May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Connection: keep-alive May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Content-Length: 0 May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Host: 10.222.0.99 May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Openstack-Api-Version: compute 2.90 May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Openstack-System-Scope: None May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: User-Agent: python-novaclient May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Auth-Token: gAAAAABifm923La4aQ3UFGQm4Y6kSYTgruOAZJUbPMf7sO1uQ6dba3_lCs8c7AVqComMpKPRTpdkylrhFqg85JFRN78kz7wokBNCLtKRjog1LW8aAMOUozZdYXLZEwjrPOOLotsX2DcYQMCBCW1N2y4Ik_SBDqOIdsfxzo4gPczFo-mQjdVhnxM May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Domain-Id: None May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Domain-Name: None May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Identity-Status: Confirmed May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Is-Admin-Project: True May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Openstack-Nova-Api-Version: 2.90 May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Project-Domain-Id: default May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Project-Domain-Name: Default May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Project-Id: 874372a810af4de2a4ad12d67714243a May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Project-Name: admin May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Role: admin,reader,member May 13 14:47:19.056680 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Roles: admin,reader,member May 13 14:47:19.058216 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_874372a810af4de2a4ad12d67714243a", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/874372a810af4de2a4ad12d67714243a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/874372a810af4de2a4ad12d67714243a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/874372a810af4de2a4ad12d67714243a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:47:19.058216 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Tenant: admin May 13 14:47:19.058216 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Tenant-Id: 874372a810af4de2a4ad12d67714243a May 13 14:47:19.058216 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Tenant-Name: admin May 13 14:47:19.058216 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-User: admin May 13 14:47:19.058216 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-User-Domain-Id: default May 13 14:47:19.058216 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-User-Domain-Name: Default May 13 14:47:19.058216 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-User-Id: 3521504b5b0e494782ca07b80f916dd3 May 13 14:47:19.058216 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-User-Name: admin May 13 14:47:19.058216 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: method: > May 13 14:47:19.058216 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: exception: Flavor 84 could not be found. May 13 14:47:19.058216 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: action_args: {'id': '84'} May 13 14:47:19.058216 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:47:19.058216 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:47:19.060283 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi May 13 14:47:19.061551 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-56eba2fb-f92c-49ee-ae70-76d3e7283078 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:47:19.062807 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-56eba2fb-f92c-49ee-ae70-76d3e7283078 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.076730 May 13 14:47:19.062807 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 23/44] 10.222.0.99 () {60 vars in 1190 bytes} [Fri May 13 14:47:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 14:47:19.067896 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-f9521f33-4328-47d3-a831-6ea89e2fe19b admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:19.081482 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-f9521f33-4328-47d3-a831-6ea89e2fe19b admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017249 May 13 14:47:19.082027 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 22/45] 10.222.0.99 () {60 vars in 1210 bytes} [Fri May 13 14:47:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:47:19.091849 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-2d461dc5-658f-4a0b-a304-8e23fea91226 admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:19.106746 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-2d461dc5-658f-4a0b-a304-8e23fea91226 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018858 May 13 14:47:19.107251 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 24/46] 10.222.0.99 () {60 vars in 1210 bytes} [Fri May 13 14:47:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:47:19.116797 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-8bd2356e-19c0-4641-9b40-ddc2ce8e00eb admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:19.122383 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.wsgi [None req-8bd2356e-19c0-4641-9b40-ddc2ce8e00eb admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-8bd2356e-19c0-4641-9b40-ddc2ce8e00eb admin admin] Request method failure captured: May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Accept: application/json May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Accept-Encoding: gzip, deflate May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Connection: keep-alive May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Content-Length: 0 May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Host: 10.222.0.99 May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Openstack-Api-Version: compute 2.90 May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Openstack-System-Scope: None May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: User-Agent: python-novaclient May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Auth-Token: gAAAAABifm923La4aQ3UFGQm4Y6kSYTgruOAZJUbPMf7sO1uQ6dba3_lCs8c7AVqComMpKPRTpdkylrhFqg85JFRN78kz7wokBNCLtKRjog1LW8aAMOUozZdYXLZEwjrPOOLotsX2DcYQMCBCW1N2y4Ik_SBDqOIdsfxzo4gPczFo-mQjdVhnxM May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Domain-Id: None May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Domain-Name: None May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Identity-Status: Confirmed May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Is-Admin-Project: True May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Openstack-Nova-Api-Version: 2.90 May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Project-Domain-Id: default May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Project-Domain-Name: Default May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Project-Id: 874372a810af4de2a4ad12d67714243a May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Project-Name: admin May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Role: admin,reader,member May 13 14:47:19.123905 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Roles: admin,reader,member May 13 14:47:19.125310 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_874372a810af4de2a4ad12d67714243a", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/874372a810af4de2a4ad12d67714243a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/874372a810af4de2a4ad12d67714243a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/874372a810af4de2a4ad12d67714243a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:47:19.125310 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Tenant: admin May 13 14:47:19.125310 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Tenant-Id: 874372a810af4de2a4ad12d67714243a May 13 14:47:19.125310 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Tenant-Name: admin May 13 14:47:19.125310 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-User: admin May 13 14:47:19.125310 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-User-Domain-Id: default May 13 14:47:19.125310 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-User-Domain-Name: Default May 13 14:47:19.125310 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-User-Id: 3521504b5b0e494782ca07b80f916dd3 May 13 14:47:19.125310 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-User-Name: admin May 13 14:47:19.125310 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: method: > May 13 14:47:19.125310 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: exception: Flavor 84 could not be found. May 13 14:47:19.125310 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: action_args: {'id': '84'} May 13 14:47:19.125310 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:47:19.125310 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:47:19.126164 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi May 13 14:47:19.127181 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-8bd2356e-19c0-4641-9b40-ddc2ce8e00eb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:47:19.128471 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-8bd2356e-19c0-4641-9b40-ddc2ce8e00eb admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012220 May 13 14:47:19.128471 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 23/47] 10.222.0.99 () {60 vars in 1190 bytes} [Fri May 13 14:47:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 14:47:20.017606 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-2d461dc5-658f-4a0b-a304-8e23fea91226 admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:20.019263 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-2d461dc5-658f-4a0b-a304-8e23fea91226 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002192 May 13 14:47:20.019991 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 25/48] 10.222.0.99 () {56 vars in 1074 bytes} [Fri May 13 14:47:20 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:47:20.233731 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-3e8f141e-0790-4660-878b-6e1fd62aa401 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:20.242273 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.wsgi [None req-3e8f141e-0790-4660-878b-6e1fd62aa401 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-3e8f141e-0790-4660-878b-6e1fd62aa401 admin admin] Request method failure captured: May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Accept: application/json May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Accept-Encoding: gzip, deflate May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Connection: keep-alive May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Content-Length: 0 May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Host: 10.222.0.99 May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Openstack-Api-Version: compute 2.90 May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Openstack-System-Scope: None May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: User-Agent: python-novaclient May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Auth-Token: gAAAAABifm94m-7uFdMijBb_RuU_wQ2CH2i3l_7DLBJEm6a2Ncn3ndTzCqJc5Gk1GvQAEaeiHLpgCGZ0EBfPTjMehlW_38MWSQjLx-Ux5NmxDvr7PcYcM2Z3_0RKKt7pt9CiIN2_lD8h0gqU-8fljhLNzV5EMPzCwLFxIxXOpDVDtPbAp03kmaU May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Domain-Id: None May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Domain-Name: None May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Identity-Status: Confirmed May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Is-Admin-Project: True May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Openstack-Nova-Api-Version: 2.90 May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Project-Domain-Id: default May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Project-Domain-Name: Default May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Project-Id: 874372a810af4de2a4ad12d67714243a May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Project-Name: admin May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Role: admin,reader,member May 13 14:47:20.244626 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Roles: admin,reader,member May 13 14:47:20.246011 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_874372a810af4de2a4ad12d67714243a", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/874372a810af4de2a4ad12d67714243a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/874372a810af4de2a4ad12d67714243a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/874372a810af4de2a4ad12d67714243a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:47:20.246011 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Tenant: admin May 13 14:47:20.246011 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Tenant-Id: 874372a810af4de2a4ad12d67714243a May 13 14:47:20.246011 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-Tenant-Name: admin May 13 14:47:20.246011 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-User: admin May 13 14:47:20.246011 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-User-Domain-Id: default May 13 14:47:20.246011 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-User-Domain-Name: Default May 13 14:47:20.246011 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-User-Id: 3521504b5b0e494782ca07b80f916dd3 May 13 14:47:20.246011 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: X-User-Name: admin May 13 14:47:20.246011 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: method: > May 13 14:47:20.246011 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: exception: Flavor 451 could not be found. May 13 14:47:20.246011 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: action_args: {'id': '451'} May 13 14:47:20.246011 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:47:20.246011 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:47:20.246816 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: ERROR nova.api.openstack.wsgi May 13 14:47:20.247944 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-3e8f141e-0790-4660-878b-6e1fd62aa401 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102962) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:47:20.249285 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-3e8f141e-0790-4660-878b-6e1fd62aa401 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.081254 May 13 14:47:20.249285 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 24/49] 10.222.0.99 () {60 vars in 1193 bytes} [Fri May 13 14:47:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 14:47:20.257273 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-772e3aea-880f-4818-8af2-1e9e1d0bc281 admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:20.270973 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-772e3aea-880f-4818-8af2-1e9e1d0bc281 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017460 May 13 14:47:20.271497 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 26/50] 10.222.0.99 () {60 vars in 1210 bytes} [Fri May 13 14:47:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:47:20.280961 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-cae7f7ef-e4a7-4d01-a52e-653ebd6fa1f5 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:20.295237 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-cae7f7ef-e4a7-4d01-a52e-653ebd6fa1f5 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017863 May 13 14:47:20.295757 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 25/51] 10.222.0.99 () {60 vars in 1210 bytes} [Fri May 13 14:47:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:47:20.305367 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-2e75975e-413d-4582-bfd2-688b36bd9d0f admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:20.311264 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.wsgi [None req-2e75975e-413d-4582-bfd2-688b36bd9d0f admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-2e75975e-413d-4582-bfd2-688b36bd9d0f admin admin] Request method failure captured: May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Accept: application/json May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Accept-Encoding: gzip, deflate May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Connection: keep-alive May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Content-Length: 0 May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Host: 10.222.0.99 May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Openstack-Api-Version: compute 2.90 May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Openstack-System-Scope: None May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: User-Agent: python-novaclient May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Auth-Token: gAAAAABifm94m-7uFdMijBb_RuU_wQ2CH2i3l_7DLBJEm6a2Ncn3ndTzCqJc5Gk1GvQAEaeiHLpgCGZ0EBfPTjMehlW_38MWSQjLx-Ux5NmxDvr7PcYcM2Z3_0RKKt7pt9CiIN2_lD8h0gqU-8fljhLNzV5EMPzCwLFxIxXOpDVDtPbAp03kmaU May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Domain-Id: None May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Domain-Name: None May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Identity-Status: Confirmed May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Is-Admin-Project: True May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Openstack-Nova-Api-Version: 2.90 May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Project-Domain-Id: default May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Project-Domain-Name: Default May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Project-Id: 874372a810af4de2a4ad12d67714243a May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Project-Name: admin May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Role: admin,reader,member May 13 14:47:20.312815 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Roles: admin,reader,member May 13 14:47:20.314289 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_874372a810af4de2a4ad12d67714243a", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/874372a810af4de2a4ad12d67714243a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/874372a810af4de2a4ad12d67714243a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/874372a810af4de2a4ad12d67714243a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:47:20.314289 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Tenant: admin May 13 14:47:20.314289 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Tenant-Id: 874372a810af4de2a4ad12d67714243a May 13 14:47:20.314289 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-Tenant-Name: admin May 13 14:47:20.314289 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-User: admin May 13 14:47:20.314289 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-User-Domain-Id: default May 13 14:47:20.314289 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-User-Domain-Name: Default May 13 14:47:20.314289 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-User-Id: 3521504b5b0e494782ca07b80f916dd3 May 13 14:47:20.314289 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: X-User-Name: admin May 13 14:47:20.314289 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: method: > May 13 14:47:20.314289 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: exception: Flavor 451 could not be found. May 13 14:47:20.314289 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: action_args: {'id': '451'} May 13 14:47:20.314289 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:47:20.314289 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:47:20.315222 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: ERROR nova.api.openstack.wsgi May 13 14:47:20.317030 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-2e75975e-413d-4582-bfd2-688b36bd9d0f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102963) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:47:20.318306 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-2e75975e-413d-4582-bfd2-688b36bd9d0f admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012623 May 13 14:47:20.318306 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 27/52] 10.222.0.99 () {60 vars in 1193 bytes} [Fri May 13 14:47:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 14:47:21.228192 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-cae7f7ef-e4a7-4d01-a52e-653ebd6fa1f5 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:21.229235 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-cae7f7ef-e4a7-4d01-a52e-653ebd6fa1f5 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 13 14:47:21.229644 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 26/53] 10.222.0.99 () {56 vars in 1074 bytes} [Fri May 13 14:47:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:47:21.436127 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-75d5bc11-4c38-4130-9785-19fe32dc9966 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:47:21.455669 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-75d5bc11-4c38-4130-9785-19fe32dc9966 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.088185 May 13 14:47:21.456244 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 28/54] 10.222.0.99 () {64 vars in 1235 bytes} [Fri May 13 14:47:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:47:22.339232 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-cae7f7ef-e4a7-4d01-a52e-653ebd6fa1f5 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:22.340290 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-cae7f7ef-e4a7-4d01-a52e-653ebd6fa1f5 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 13 14:47:22.340684 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 27/55] 10.222.0.99 () {56 vars in 1074 bytes} [Fri May 13 14:47:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:47:22.536776 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-e37ee3c1-acde-4c02-9a25-077a8fe2a965 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:47:22.556480 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-e37ee3c1-acde-4c02-9a25-077a8fe2a965 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.080190 May 13 14:47:22.556961 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 29/56] 10.222.0.99 () {64 vars in 1235 bytes} [Fri May 13 14:47:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:47:23.499094 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-cae7f7ef-e4a7-4d01-a52e-653ebd6fa1f5 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:23.500135 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-cae7f7ef-e4a7-4d01-a52e-653ebd6fa1f5 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 13 14:47:23.500527 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 28/57] 10.222.0.99 () {56 vars in 1074 bytes} [Fri May 13 14:47:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:47:23.720273 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-ca6df43c-b3d8-4f55-a58b-a9d56d81d97e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:47:23.744956 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-ca6df43c-b3d8-4f55-a58b-a9d56d81d97e admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.105779 May 13 14:47:23.745511 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 30/58] 10.222.0.99 () {64 vars in 1235 bytes} [Fri May 13 14:47:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:47:24.646515 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-cae7f7ef-e4a7-4d01-a52e-653ebd6fa1f5 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:24.647532 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-cae7f7ef-e4a7-4d01-a52e-653ebd6fa1f5 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 13 14:47:24.647996 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 29/59] 10.222.0.99 () {56 vars in 1074 bytes} [Fri May 13 14:47:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:47:24.841855 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-de05d2fa-a99b-44e2-99a7-e1d601b41ba0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:47:24.861139 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-de05d2fa-a99b-44e2-99a7-e1d601b41ba0 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.074378 May 13 14:47:24.861703 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 31/60] 10.222.0.99 () {64 vars in 1235 bytes} [Fri May 13 14:47:24 2022] POST /compute/v2.1/flavors => generated 409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:47:25.758392 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-cae7f7ef-e4a7-4d01-a52e-653ebd6fa1f5 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:25.759399 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-cae7f7ef-e4a7-4d01-a52e-653ebd6fa1f5 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 May 13 14:47:25.759803 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 30/61] 10.222.0.99 () {56 vars in 1074 bytes} [Fri May 13 14:47:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:47:25.947689 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-fe53e510-bcf8-4812-95df-dacaf1966e7a admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:47:25.968410 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-fe53e510-bcf8-4812-95df-dacaf1966e7a admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.075094 May 13 14:47:25.968955 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 32/62] 10.222.0.99 () {60 vars in 1202 bytes} [Fri May 13 14:47:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:48:28.119855 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-cae7f7ef-e4a7-4d01-a52e-653ebd6fa1f5 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:48:28.121132 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-cae7f7ef-e4a7-4d01-a52e-653ebd6fa1f5 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002017 May 13 14:48:28.121739 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 31/63] 10.222.0.99 () {54 vars in 930 bytes} [Fri May 13 14:48:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:48:28.185246 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-f76a3ede-207b-40a3-8e01-0cea415b86be admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:48:28.204882 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-f76a3ede-207b-40a3-8e01-0cea415b86be admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075557 May 13 14:48:28.205445 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 33/64] 10.222.0.99 () {60 vars in 1291 bytes} [Fri May 13 14:48:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:48:28.227832 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-f121ec15-3d52-45aa-8bd9-1f778f236a1c admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:48:28.235668 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-f121ec15-3d52-45aa-8bd9-1f778f236a1c admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012385 May 13 14:48:28.236213 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 32/65] 10.222.0.99 () {60 vars in 1282 bytes} [Fri May 13 14:48:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:48:28.247200 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-cecc8ce1-dfa1-4daa-83b4-89531ec5a705 admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:48:28.255018 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-cecc8ce1-dfa1-4daa-83b4-89531ec5a705 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011365 May 13 14:48:28.255527 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 34/66] 10.222.0.99 () {60 vars in 1285 bytes} [Fri May 13 14:48:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:48:28.266445 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-51f5cb37-78fb-4c48-a3f9-880bb2c702c9 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:48:28.274333 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-51f5cb37-78fb-4c48-a3f9-880bb2c702c9 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011415 May 13 14:48:28.274838 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 33/67] 10.222.0.99 () {60 vars in 1285 bytes} [Fri May 13 14:48:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:48:28.286302 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-aed08f2c-de8a-4e97-9ebf-64799b495624 admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:48:28.294188 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-aed08f2c-de8a-4e97-9ebf-64799b495624 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011523 May 13 14:48:28.294741 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 35/68] 10.222.0.99 () {60 vars in 1282 bytes} [Fri May 13 14:48:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:51:53.895584 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-51f5cb37-78fb-4c48-a3f9-880bb2c702c9 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:51:53.896631 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-51f5cb37-78fb-4c48-a3f9-880bb2c702c9 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 13 14:51:53.897013 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 34/69] 10.222.0.99 () {56 vars in 1074 bytes} [Fri May 13 14:51:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:51:54.176510 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-42ce0ff4-ddb6-4cec-8531-56aeec989179 admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:51:54.177702 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 14:51:54.177702 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: warnings.warn(msg) May 13 14:51:54.178936 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-42ce0ff4-ddb6-4cec-8531-56aeec989179 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:51:54.179384 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-42ce0ff4-ddb6-4cec-8531-56aeec989179 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:51:54.180223 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-42ce0ff4-ddb6-4cec-8531-56aeec989179 admin admin] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:51:54.180657 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-42ce0ff4-ddb6-4cec-8531-56aeec989179 admin admin] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:51:54.214196 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-42ce0ff4-ddb6-4cec-8531-56aeec989179 admin admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.162659 May 13 14:51:54.214750 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 36/70] 10.222.0.99 () {60 vars in 1193 bytes} [Fri May 13 14:51:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:51:55.132822 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-51f5cb37-78fb-4c48-a3f9-880bb2c702c9 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:51:55.133957 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-51f5cb37-78fb-4c48-a3f9-880bb2c702c9 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 May 13 14:51:55.134474 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 35/71] 10.222.0.99 () {56 vars in 1074 bytes} [Fri May 13 14:51:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:51:55.331373 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-27424c12-2793-4cc4-9413-bbe3a4151ced admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:51:55.332569 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 14:51:55.332569 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: warnings.warn(msg) May 13 14:51:55.333748 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-27424c12-2793-4cc4-9413-bbe3a4151ced admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:51:55.334181 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-27424c12-2793-4cc4-9413-bbe3a4151ced admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:51:55.334959 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-27424c12-2793-4cc4-9413-bbe3a4151ced admin admin] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:51:55.335373 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-27424c12-2793-4cc4-9413-bbe3a4151ced admin admin] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:51:55.354019 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-27424c12-2793-4cc4-9413-bbe3a4151ced admin admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081547 May 13 14:51:55.354881 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 37/72] 10.222.0.99 () {60 vars in 1193 bytes} [Fri May 13 14:51:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:52:06.710839 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-51f5cb37-78fb-4c48-a3f9-880bb2c702c9 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:52:06.711848 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-51f5cb37-78fb-4c48-a3f9-880bb2c702c9 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 13 14:52:06.712298 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 36/73] 10.222.0.99 () {56 vars in 1074 bytes} [Fri May 13 14:52:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:52:06.906557 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-daacd01a-faea-4997-b105-5b1b75ad73db admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:52:06.907768 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 14:52:06.907768 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: warnings.warn(msg) May 13 14:52:06.908997 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-daacd01a-faea-4997-b105-5b1b75ad73db admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:52:06.909457 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-daacd01a-faea-4997-b105-5b1b75ad73db admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:52:06.910463 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-daacd01a-faea-4997-b105-5b1b75ad73db admin admin] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:52:06.910888 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-daacd01a-faea-4997-b105-5b1b75ad73db admin admin] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:52:06.936392 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-daacd01a-faea-4997-b105-5b1b75ad73db admin admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087946 May 13 14:52:06.936944 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 38/74] 10.222.0.99 () {60 vars in 1193 bytes} [Fri May 13 14:52:06 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:52:07.839004 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: DEBUG nova.api.openstack.wsgi [None req-51f5cb37-78fb-4c48-a3f9-880bb2c702c9 admin admin] Calling method '>' {{(pid=102962) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:52:07.840083 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: INFO nova.api.openstack.requestlog [None req-51f5cb37-78fb-4c48-a3f9-880bb2c702c9 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 13 14:52:07.840484 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: [pid: 102962|app: 0|req: 37/75] 10.222.0.99 () {56 vars in 1074 bytes} [Fri May 13 14:52:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:52:08.041154 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG nova.api.openstack.wsgi [None req-226edd84-88fd-41fc-8bba-a8de0237955f admin admin] Calling method '>' {{(pid=102963) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:52:08.042383 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 14:52:08.042383 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: warnings.warn(msg) May 13 14:52:08.043488 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-226edd84-88fd-41fc-8bba-a8de0237955f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:52:08.043956 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-226edd84-88fd-41fc-8bba-a8de0237955f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:52:08.044725 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-226edd84-88fd-41fc-8bba-a8de0237955f admin admin] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:52:08.045143 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: DEBUG oslo_concurrency.lockutils [None req-226edd84-88fd-41fc-8bba-a8de0237955f admin admin] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102963) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:52:08.065967 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: INFO nova.api.openstack.requestlog [None req-226edd84-88fd-41fc-8bba-a8de0237955f admin admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087893 May 13 14:52:08.066502 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: [pid: 102963|app: 0|req: 39/76] 10.222.0.99 () {60 vars in 1193 bytes} [Fri May 13 14:52:07 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:53:09.545933 dv-cinder-830901-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 13 14:53:09.546837 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: Fri May 13 14:53:09 2022 - graceful shutdown triggered... May 13 14:53:09.547299 dv-cinder-830901-6-iscsi devstack@n-api.service[102962]: Gracefully killing worker 1 (pid: 102962)... May 13 14:53:09.547669 dv-cinder-830901-6-iscsi devstack@n-api.service[102963]: Gracefully killing worker 2 (pid: 102963)... May 13 14:53:10.547733 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: worker 1 buried after 1 seconds May 13 14:53:10.547733 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: worker 2 buried after 1 seconds May 13 14:53:10.547733 dv-cinder-830901-6-iscsi devstack@n-api.service[102959]: goodbye to uWSGI. May 13 14:53:10.549539 dv-cinder-830901-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 13 14:53:10.550360 dv-cinder-830901-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 13 14:53:10.553676 dv-cinder-830901-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 14:53:10.569857 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 14:53:10.591352 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 14:53:10 2022] *** May 13 14:53:10.591352 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 14:53:10.591352 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 14:53:10.591352 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: nodename: dv-cinder-830901-6-iscsi May 13 14:53:10.591352 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: machine: x86_64 May 13 14:53:10.591352 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: clock source: unix May 13 14:53:10.591352 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: pcre jit disabled May 13 14:53:10.591352 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: detected number of CPU cores: 4 May 13 14:53:10.591352 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: current working directory: / May 13 14:53:10.591352 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: detected binary path: /usr/bin/uwsgi-core May 13 14:53:10.591352 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: your processes number limit is 47680 May 13 14:53:10.591352 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: your memory page size is 4096 bytes May 13 14:53:10.591352 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: detected max file descriptor number: 2048 May 13 14:53:10.591352 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: lock engine: pthread robust mutexes May 13 14:53:10.592451 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: thunder lock: enabled May 13 14:53:10.592451 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 14:53:10.592451 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 14:53:10.643674 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: Python main interpreter initialized at 0x55665288b9c0 May 13 14:53:10.643674 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: python threads support enabled May 13 14:53:10.643674 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: your server socket listen backlog is limited to 100 connections May 13 14:53:10.643674 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: your mercy for graceful operations on workers is 90 seconds May 13 14:53:10.644572 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: mapped 403077 bytes (393 KB) for 2 cores May 13 14:53:10.644676 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: *** Operational MODE: preforking *** May 13 14:53:10.644979 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: *** uWSGI is running in multiple interpreter mode *** May 13 14:53:10.644979 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: spawned uWSGI master process (pid: 117280) May 13 14:53:10.645190 dv-cinder-830901-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 14:53:10.645794 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: spawned uWSGI worker 1 (pid: 117295, cores: 1) May 13 14:53:10.646156 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: spawned uWSGI worker 2 (pid: 117296, cores: 1) May 13 14:53:10.646300 dv-cinder-830901-6-iscsi devstack@n-api.service[117280]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 14:53:11.850783 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 14:53:11.874398 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 14:53:12.653193 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 14:53:12.653193 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: from cryptography.utils import int_from_bytes May 13 14:53:12.653553 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 14:53:12.653553 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: from cryptography.utils import int_from_bytes May 13 14:53:12.667389 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 14:53:12.667389 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: from cryptography.utils import int_from_bytes May 13 14:53:12.667661 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 14:53:12.667661 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: from cryptography.utils import int_from_bytes May 13 14:53:15.089196 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 14:53:15.089903 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 14:53:15.089987 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 14:53:15.090339 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 14:53:15.090595 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 14:53:15.090985 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.091311 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.091637 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.092030 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.092368 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.092692 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.093004 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.093324 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.093657 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.093920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.094238 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.094568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830901-6-iscsi {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.094890 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.095198 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.095512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.095814 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.096148 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.096522 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.096835 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.097338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.097788 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.098099 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.098415 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.098758 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.099076 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.099390 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.099712 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.100041 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.100386 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.100685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.101088 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830901-6-iscsi {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.101408 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.101738 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.102393 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.102819 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.103124 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.103438 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.103759 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.104112 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.104430 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.104757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.105079 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.105400 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.105721 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.106025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.106335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.106648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.106966 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.107271 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.107576 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.107826 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.108161 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.108484 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.108805 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.109129 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.109384 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.109635 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.109954 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.110274 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.110581 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.110890 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.111198 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.111506 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.111812 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.112236 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.112548 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.112858 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.113178 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.113497 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.113819 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.114130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.114452 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.114849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.99 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.115104 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.99 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.115415 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.115757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.116101 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.116413 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.116734 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.117055 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.117396 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.117709 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.118015 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.118335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.118660 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.118967 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.119221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.119525 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.119834 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.120178 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.120488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.120797 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.121108 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.121411 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.121720 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.122036 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.122345 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.122659 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.122968 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.123276 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.123586 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.123913 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.124225 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.124544 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.124866 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.125175 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.125483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.125793 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.126103 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.126425 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.126734 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.127044 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.127368 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.127683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.127683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.128503 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.128660 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.128967 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.129292 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.129595 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.129904 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.130220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.130530 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.130845 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.131148 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.131453 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.131761 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.132097 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.132404 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.132710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.133012 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.133332 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.133655 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.133968 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.134276 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.134582 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.134900 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.135239 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.135569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.135935 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.136254 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.136590 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.136920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.137242 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.137554 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.137871 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.138200 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.138510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.138823 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.139135 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.139454 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.139775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.140129 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.140450 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.140769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.141090 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.141402 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.141723 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.142058 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.142382 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.142694 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.143037 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.143460 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.143893 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.144206 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.144538 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.144857 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.145173 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.145488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.145812 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.146150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.146465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.146787 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.147106 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.147422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.147737 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.148074 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.148392 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.148729 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.149049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.149367 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.149682 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.150001 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.150316 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.150630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.150942 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.151249 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.151556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.151890 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.152200 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.152505 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.152830 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.153158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.153466 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.153800 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.154108 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.154424 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.154736 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.155049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.155357 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.155669 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.156006 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.156316 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.156640 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.156951 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.157260 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.157588 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.157896 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.158203 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.158519 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.158833 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.159291 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.159622 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.159966 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.160296 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.160616 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.160936 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.161272 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.161610 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.161929 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.162261 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.162593 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.162916 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.163224 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.163537 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.163849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.164181 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.164490 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.164805 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.165113 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.165421 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.165728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.166034 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.166342 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.166667 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.166982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.167293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.167602 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.167929 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.168279 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.168590 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.168934 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.169270 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.169594 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.169917 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.170234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.170554 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.170866 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.171182 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.171497 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.171819 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.172168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.172483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.172807 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.173121 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.173213 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 14:53:15.173638 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.173733 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 14:53:15.173818 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.173971 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 14:53:15.174074 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.174339 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 14:53:15.174441 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.174664 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 14:53:15.174765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.175089 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.175427 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.175599 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.175751 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.175967 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.176104 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.176307 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.176410 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.176640 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.176733 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.176985 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.177085 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.177305 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.177411 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.177628 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.177727 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.177944 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.178037 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.178268 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.178368 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.178534 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.178666 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.178858 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.178998 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.179186 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.179316 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830901-6-iscsi {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.179509 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.179643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.179854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.180065 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.180162 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.180261 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.180457 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.180558 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.180773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.180875 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.181098 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.181190 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.181413 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.181506 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.181737 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.181919 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.182036 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.182237 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.182363 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.182551 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.182680 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.182869 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.182991 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.183212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.183305 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.183532 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.183624 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.183848 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.183972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.184202 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.184294 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.184520 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.184622 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.184836 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.184930 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.185147 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.185239 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.185452 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.185557 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830901-6-iscsi {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.185772 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.185865 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.186083 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.186306 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.186449 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.186548 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.186682 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.186872 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.186993 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.187191 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.187320 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.187507 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.187634 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.187833 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.187982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.188193 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.188300 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.188510 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.188614 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.188843 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.188939 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.189166 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.189269 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.189489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.189591 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.189793 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.189910 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.190104 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.190207 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.190474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.190889 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.191002 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.191132 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.191240 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.191439 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.191565 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.191766 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.191917 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.192117 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.192228 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.192433 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.192534 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.192750 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.192846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.193065 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.193175 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.193376 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.193470 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.193698 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.193797 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.193957 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.194049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.194215 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.194350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.194541 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.194635 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.194868 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.194961 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.195181 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.195275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.195497 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.195605 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.195811 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.195969 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.196145 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.196244 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.196458 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.196562 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.196773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.196874 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.197081 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.197173 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.197388 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.197489 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.197706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.197797 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.198025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.198286 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.198388 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.198621 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.198717 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.198942 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.199037 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.199262 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.199369 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.99 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.199587 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.199680 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.99 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.199924 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.200021 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.200260 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.200382 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.200585 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.200685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.200902 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.200994 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.201224 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.201324 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.201540 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.201676 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.201851 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.201990 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.202157 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.202259 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.202469 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.202561 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.202773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.202878 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.203081 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.203180 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.203386 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.203486 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.203648 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.203747 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.203991 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.204085 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.204307 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.204450 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.204611 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.204703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.204916 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.205018 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.205231 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.205322 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.205537 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.205629 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.205915 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.206178 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.206322 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.206658 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.206757 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.206983 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.207084 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.207295 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.207386 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.207606 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.207706 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.207937 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.208087 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.208287 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.208382 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.208597 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.208690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.208937 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.209039 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.209252 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.209343 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.209580 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.209674 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.209891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.210034 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.210198 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.210318 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.210517 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.210628 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.210821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.210964 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.211130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.211238 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.211435 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.211528 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.211752 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.211853 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.212092 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.212188 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.212399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.212505 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.212712 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.212806 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.213025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.213127 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.213337 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.213442 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.213648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.213741 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.213957 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.214050 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.214269 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.214370 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.214576 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.214674 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.214890 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.214981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.215201 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.215305 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.215506 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.215606 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.215809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.215933 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.216146 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.216298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.216455 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.216546 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.216762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.216854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.217100 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.217206 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.217407 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.217500 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.217717 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.217809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.218022 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.218125 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.218328 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.218428 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.218632 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.218768 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.218946 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.219073 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.219255 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.219353 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.219558 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.219657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.219921 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 14:53:15.220017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.220204 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.220330 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.220510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.220675 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.220818 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.220919 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.221129 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.221221 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.221443 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.221623 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.221842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.222170 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.222365 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.222498 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.222703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.222811 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.223027 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.223128 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.223355 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.223447 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.223692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.223794 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.224028 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.224120 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.224339 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.224445 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.224651 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.224798 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.224957 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.225057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.225266 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.225359 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.225572 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.225673 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.225879 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.225979 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.226186 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.226279 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.226510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.226606 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.227165 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.227252 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.227472 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.227554 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.227781 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.227863 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.228113 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.228195 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.228460 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.228545 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.228769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.228898 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.229135 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.229268 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.229432 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.229539 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.229750 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.229843 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.230070 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.230162 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.230387 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.230487 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.230703 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.230825 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.231019 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.231128 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.231321 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.231422 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.231640 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.231732 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.231980 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.232089 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.232303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.232409 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.232611 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.232715 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.232918 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.233013 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.233239 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.233333 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.233552 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.233644 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.233865 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.233966 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.234188 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.234317 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.234513 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.234611 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.234838 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.234930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.235142 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.235242 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.235455 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.235554 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.235770 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.235908 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.236106 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.236208 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.236419 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.236511 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.236729 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.236827 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.237039 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.237183 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.237452 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.237769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.238013 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.238265 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.238367 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.238585 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.238677 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.238898 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.238990 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.239218 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.239345 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.239535 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.239648 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.239843 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.239950 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.240193 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.240294 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.240508 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.240608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.240823 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.240941 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.241135 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.241238 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.241445 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.241546 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.241758 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.241860 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.242069 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.242169 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.242401 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.242492 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.242733 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.242839 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.243054 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.243155 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.243371 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.243463 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.243698 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.243802 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.244036 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.244141 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.244353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.244452 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.244665 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.244764 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.244972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.245104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.245287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.245377 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.245607 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.245701 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.245928 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.246040 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.246261 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.246354 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.246588 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.246680 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.246896 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.246996 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.247212 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.247306 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.247540 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.247634 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.247851 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.248013 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.248181 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.248288 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.248488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.248583 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.248813 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.248943 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.249120 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.249225 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.249444 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.249557 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.249761 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.249854 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.250077 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.250179 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.250392 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.250496 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.250712 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.250923 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.251038 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.251176 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.251326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.251490 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.251641 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.251820 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.251963 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.252171 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.252265 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.252498 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.252590 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.252871 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.253403 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.253504 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.253721 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.253814 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.254049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.254141 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.254380 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.254471 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.254696 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.254795 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.255019 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.255119 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.255329 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.255435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.255659 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.255760 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.256008 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.256118 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.256330 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.256424 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.256654 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.256753 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.256979 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.257081 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.257300 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.257400 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.257622 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.257714 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.257941 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.258042 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.258260 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.258360 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.258592 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.258693 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.258901 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.259006 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.259215 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.259311 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.259578 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.259684 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.259834 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.259973 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.260181 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.260273 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.260488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.260587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.260804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.260907 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.261122 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.261225 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.261421 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.261522 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.261729 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.261830 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.262044 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.262145 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.262370 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.262463 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.262678 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.262782 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.263001 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.263102 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.263315 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.263415 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.263633 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.263726 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.263977 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.264072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.264289 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.264468 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.264611 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.264711 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.264922 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.265014 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.265231 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.265334 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.265540 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.265641 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.265848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.265938 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.266166 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.266255 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.266485 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.266565 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.266792 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.266871 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.267114 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.267196 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.267443 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.267523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.267757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.267838 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.268108 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.268191 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.268495 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.268634 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.268964 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.269321 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.269426 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.269655 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.269760 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.269962 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.270054 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.270268 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.270370 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.270582 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.270684 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.270893 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.270993 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.271203 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.271307 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.271508 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.271600 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.271821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.271976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.272157 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.272260 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.272463 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.272555 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.272769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.272869 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.273083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.273183 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.273389 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.273489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.273698 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.273800 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.274010 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.274110 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.274320 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.274421 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.274629 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.274736 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.274938 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.275032 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.275265 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.275355 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.275638 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.275758 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.275906 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.276038 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.276232 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.276365 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.276556 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.276687 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.276869 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.276989 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.278048 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.278149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.278149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.278149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.278149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.278464 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.278543 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.278624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.278703 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.278939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.279034 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.279254 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.279343 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.279582 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.279704 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.279938 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.280056 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.280259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.280360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.280580 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.280682 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.280896 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.280995 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.281282 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.281435 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.281531 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.281772 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.281874 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.282097 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.282198 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.282414 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.282515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.282729 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.282830 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.283047 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.283140 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.283366 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.283469 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.283682 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.283783 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.284060 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.284160 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.284378 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.284695 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.284937 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.285031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.285268 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.285359 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.285585 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.285732 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.285907 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.286000 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.286237 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.286329 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.286588 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.286823 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.286923 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.287208 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.287309 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.287555 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.287655 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.287918 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.288014 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.288208 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.288310 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.288528 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.288629 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.288847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.288949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.289164 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.289265 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.289479 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.289573 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.289794 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.289920 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.290113 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.290210 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.290430 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.290531 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.290742 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.290846 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.291052 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.291151 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.291368 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.291507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.291684 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.291786 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.292039 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.292133 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.292361 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.292470 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.292673 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.292784 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.292985 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.293078 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.293296 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.293400 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.293605 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.293777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.293927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.294126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.294226 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.294449 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.294551 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.294790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.294885 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.295122 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.295224 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.295452 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.295554 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.295765 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.295930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.296106 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.296214 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.296419 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.296526 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.296736 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.296827 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.297046 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.297139 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.297364 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.297467 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.297681 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.297784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.297993 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.298097 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.298323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.298424 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.298640 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.298734 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.298952 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.299054 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.299267 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.299358 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.299602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.299697 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.300224 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.300532 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.300668 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.300871 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.300995 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.301196 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.301328 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.301516 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.301666 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.301838 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.301992 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.302164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.302306 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.302489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.302635 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.302812 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.302949 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.303129 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.303263 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.303447 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.303585 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.303761 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.303929 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.304114 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.304246 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.304433 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.304559 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.304746 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.304877 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.305058 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.305193 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.305378 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.305503 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.305694 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.305819 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.306008 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.306130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.306328 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.306465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.306641 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.306777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.306965 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.307088 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.307282 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.307399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.307596 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.307702 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.307928 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.308036 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.308285 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.308386 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.308609 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.308710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.308920 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.309051 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.309232 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.309331 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.309541 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.309644 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.309851 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.309981 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.310157 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.310249 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.310472 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.310574 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.310777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.310875 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.311086 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.311181 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.311403 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.311497 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.311731 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.311828 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.312079 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.312184 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.312391 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.312484 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.312706 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.312807 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.313019 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.313118 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.313329 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.313422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.313643 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.313744 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.313956 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.314047 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.314265 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.314358 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.314580 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.314681 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.314888 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.315124 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.315268 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.315522 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.315776 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.316003 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.316150 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.316325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.316441 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.316655 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.316757 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.316971 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.317065 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.317286 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.317387 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.317599 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.317694 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.317931 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.318032 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.318250 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.318354 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.318563 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.318664 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.318878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.318982 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.319192 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.319292 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.319506 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.319599 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.319820 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.319947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.320160 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.320266 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.320475 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.320572 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.320789 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.320891 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.321102 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.321202 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.321418 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.321519 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.321735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.321844 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.322045 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.322137 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.322373 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.322473 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.322693 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.322793 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.323010 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.323109 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.323332 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.323432 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.323652 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.323753 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.323990 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.324135 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.324306 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.324401 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.324615 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.324707 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.324929 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.325029 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.325242 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.325335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.325558 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.325659 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.325874 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.325967 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.326182 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.326327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.326499 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.326599 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.326823 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.326923 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.327141 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.327245 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.327458 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.327551 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.327774 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.327895 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.328136 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.328243 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.328456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.328550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.328768 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.328869 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.329091 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.329191 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.329409 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.329510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.329720 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.329812 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.330038 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.330166 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.330348 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.330482 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.330666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.330758 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.331124 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.331238 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.331552 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.331890 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.331999 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.332216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.332311 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.332542 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.332635 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.332860 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.332961 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.333169 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.333264 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.333476 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.333576 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.333790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.333892 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.334100 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.334248 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.334408 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.334504 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.334719 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.334820 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.335028 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.335122 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.335343 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.335436 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.335648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.335755 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.335982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.336126 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.336295 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.336429 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.336604 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.336706 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.336912 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.337005 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.337221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.337322 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.337534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.337638 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.337845 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.337940 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.338157 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.338251 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.338466 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.338571 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.338776 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.339082 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.339185 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.339418 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.339519 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.339752 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.339853 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.340096 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.340230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.340424 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.340549 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.340741 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.340866 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.341066 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.341193 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.341382 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.341517 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.341714 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.341848 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.342040 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.342159 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.342361 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.342478 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.342677 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.342795 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.343019 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.343123 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.343338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.343439 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.343657 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.343749 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.344003 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.344112 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.344321 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.344459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.344636 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.344729 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.344951 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.345080 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.345282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.345402 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.345610 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.345729 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.345920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.346099 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.346248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.346341 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.346704 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.346843 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.347046 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.347375 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.347532 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.347690 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.347894 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.348048 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.348212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.348367 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.348527 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.348684 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.348849 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.349004 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.349163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.349320 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.349478 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.349637 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.349806 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.349958 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.350119 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.350279 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.350440 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.350609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.350760 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.350935 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.351078 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.351249 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.351392 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.351582 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.351705 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.352277 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.352401 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.352631 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.352724 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.352948 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.353042 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.353296 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.353398 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.353626 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.353771 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.353946 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.354075 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.354255 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.354373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.354559 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.354687 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.354806 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117295) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 14:53:15.354928 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.355186 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.355498 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.355811 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.356187 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.356507 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.356837 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.357173 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.357506 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.357821 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.358160 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.358493 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.358816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.359142 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.359470 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.359779 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.360117 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.360436 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.360748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.361060 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.361370 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.361684 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.361993 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.362874 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.363200 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.363538 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.363858 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.364217 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.364540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.364859 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.365177 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.365493 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.365844 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.366158 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.366504 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.366831 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.367162 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.367499 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.367818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.368178 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.368506 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.368830 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.369153 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.369477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.369800 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.370124 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.370449 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.370766 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.371091 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.371415 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.371742 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.372316 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.372654 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.372980 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.373518 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.373712 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.374053 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.374361 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.374682 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.375004 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.375324 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.375644 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.376010 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.376344 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.376678 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.377025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.377352 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.377674 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.378739 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.379070 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.379304 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_db.sqlalchemy.engines [None req-60391bfb-290b-4e79-85a8-f7a20f72ff38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:53:15.379451 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.379787 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.380138 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.380468 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.380797 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.381124 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.381448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.381769 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.382095 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.382417 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.382738 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.383057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.383381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.383704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.384064 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.384407 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.384738 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.385062 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.385384 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.385709 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.386272 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.386597 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.386938 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.387271 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.387602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.387953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.388285 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.388620 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.388934 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.389247 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.389565 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.389882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.390195 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.390524 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.390843 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.391157 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.391485 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.391800 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.392372 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.392736 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.393063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.393424 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.394242 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.394573 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.394896 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.395231 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.395550 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.395915 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.396229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.396554 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.396870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.397186 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.397510 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.397831 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.398145 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.398468 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.398786 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.399124 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.399440 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.399754 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.400105 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.400429 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.400745 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.401058 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.401371 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.401685 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.402004 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.402316 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.402633 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.402945 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.403263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.403574 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.403906 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.404276 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.404608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.404922 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.405235 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.405560 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.405884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.406215 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.406535 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.406855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.407209 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.407531 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.408108 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.408452 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.408778 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.409610 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.409972 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.410291 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.410610 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.410929 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.411267 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.411590 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.412896 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.412896 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.412896 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.412896 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.413538 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.413538 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.413927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.414239 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.414560 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.414877 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.415197 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.415518 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.415893 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.416230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.416555 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.416879 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.417203 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.417521 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.417841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.418157 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.418472 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.418829 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.419166 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.419481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.419795 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.420244 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.420563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.420891 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.421222 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.421540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.421864 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.422197 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.422515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.422843 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.423162 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.423497 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.423828 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.424190 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.424526 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.425111 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.425672 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.426018 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.426357 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.426698 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.427027 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.427345 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.427695 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.428045 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.428368 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.428683 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.428968 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.429284 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.429602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.429913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.430225 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.430535 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.430844 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.431155 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.431467 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.431781 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.432119 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.432435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.432746 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.433060 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.433373 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.433713 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.434050 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.434372 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.434891 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.435226 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.435624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.435893 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.436228 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.436586 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.436948 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.437227 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.437573 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.437887 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.438209 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.438715 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.438888 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.439304 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.439446 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.439754 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.440292 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.440529 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.440854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.441252 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.441596 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.441908 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.442225 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.442554 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.442872 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.443186 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.443506 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.443821 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.444163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.444260 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.context [None req-60391bfb-290b-4e79-85a8-f7a20f72ff38 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f561f54-7711-4fce-bd48-81b057a05d37(cell1) {{(pid=117295) load_cells /opt/stack/nova/nova/context.py:464}} May 13 14:53:15.444486 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.444802 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.445131 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.445464 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.445775 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.446105 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.446435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.446788 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.447102 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.447446 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.447773 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.448118 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.448418 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.448631 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-60391bfb-290b-4e79-85a8-f7a20f72ff38 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:53:15.448727 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 14:53:15.448958 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117296) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 14:53:15.450207 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-60391bfb-290b-4e79-85a8-f7a20f72ff38 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:53:15.451030 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-60391bfb-290b-4e79-85a8-f7a20f72ff38 None None] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:53:15.453039 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-60391bfb-290b-4e79-85a8-f7a20f72ff38 None None] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:53:15.466734 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_db.sqlalchemy.engines [None req-60391bfb-290b-4e79-85a8-f7a20f72ff38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:53:15.467841 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_db.sqlalchemy.engines [None req-60391bfb-290b-4e79-85a8-f7a20f72ff38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:53:15.473591 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_db.sqlalchemy.engines [None req-5dc75b6e-d069-4db8-8afb-e52818bd1a66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:53:15.539938 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.context [None req-5dc75b6e-d069-4db8-8afb-e52818bd1a66 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0f561f54-7711-4fce-bd48-81b057a05d37(cell1) {{(pid=117296) load_cells /opt/stack/nova/nova/context.py:464}} May 13 14:53:15.544622 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5dc75b6e-d069-4db8-8afb-e52818bd1a66 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:53:15.546352 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5dc75b6e-d069-4db8-8afb-e52818bd1a66 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:53:15.547309 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5dc75b6e-d069-4db8-8afb-e52818bd1a66 None None] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:53:15.549477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5dc75b6e-d069-4db8-8afb-e52818bd1a66 None None] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:53:15.563434 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_db.sqlalchemy.engines [None req-5dc75b6e-d069-4db8-8afb-e52818bd1a66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:53:15.565283 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_db.sqlalchemy.engines [None req-5dc75b6e-d069-4db8-8afb-e52818bd1a66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:53:15.633587 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_db.sqlalchemy.engines [None req-60391bfb-290b-4e79-85a8-f7a20f72ff38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117295) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:53:15.734914 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_db.sqlalchemy.engines [None req-5dc75b6e-d069-4db8-8afb-e52818bd1a66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117296) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 14:53:15.953407 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: WARNING keystonemiddleware.auth_token [None req-60391bfb-290b-4e79-85a8-f7a20f72ff38 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 14:53:15.961400 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: WARNING keystonemiddleware.auth_token [None req-60391bfb-290b-4e79-85a8-f7a20f72ff38 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 14:53:16.063928 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: WARNING keystonemiddleware.auth_token [None req-5dc75b6e-d069-4db8-8afb-e52818bd1a66 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 14:53:16.071975 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: WARNING keystonemiddleware.auth_token [None req-5dc75b6e-d069-4db8-8afb-e52818bd1a66 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 14:53:16.324187 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: WARNING keystonemiddleware.auth_token [None req-60391bfb-290b-4e79-85a8-f7a20f72ff38 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 14:53:16.330507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: WARNING keystonemiddleware.auth_token [None req-60391bfb-290b-4e79-85a8-f7a20f72ff38 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 14:53:16.336363 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55665288b9c0 pid: 117295 (default app) May 13 14:53:16.443775 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: WARNING keystonemiddleware.auth_token [None req-5dc75b6e-d069-4db8-8afb-e52818bd1a66 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 14:53:16.450277 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: WARNING keystonemiddleware.auth_token [None req-5dc75b6e-d069-4db8-8afb-e52818bd1a66 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 14:53:16.455764 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55665288b9c0 pid: 117296 (default app) May 13 14:53:59.586479 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-66ea8277-7c35-4f59-98cc-8f93c062a873 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Action: 'create', calling method: .version_select at 0x7fcf49987280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2119965531"}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:01.424954 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a4ab2b4a-224b-4284-a354-8663e13e61a1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2057376214", "imageRef": "eac0bc7b-d963-4624-aba3-a81fd1bf324c", "flavorRef": "452", "networks": [{"uuid": "acc523f8-1d3b-416d-bab1-2c773466a423"}]}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:01.870949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.network.neutron [None req-a4ab2b4a-224b-4284-a354-8663e13e61a1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] validate_networks() for [('acc523f8-1d3b-416d-bab1-2c773466a423', None, None, None, None, None)] {{(pid=117296) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:54:01.971743 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-66ea8277-7c35-4f59-98cc-8f93c062a873 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.014938 May 13 14:54:01.972609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 1/1] 10.222.0.99 () {60 vars in 1154 bytes} [Fri May 13 14:53:57 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4019 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 13 14:54:01.985732 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-7d7e1624-0f51-4898-95f1-7e3e0ecaa1e8 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf497e0280>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:02.087222 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-7d7e1624-0f51-4898-95f1-7e3e0ecaa1e8 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/138ae64d-75c8-4169-b7f3-ae93c9acaf6f" status: 200 len: 345 microversion: 2.1 time: 0.105983 May 13 14:54:02.088619 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 2/2] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 14:54:01 2022] GET /compute/v2.1/os-volumes/138ae64d-75c8-4169-b7f3-ae93c9acaf6f => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:03.102047 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-78c95557-a1d4-4473-91de-48901c17f3f7 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf497e04c0>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:03.303945 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-78c95557-a1d4-4473-91de-48901c17f3f7 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/138ae64d-75c8-4169-b7f3-ae93c9acaf6f" status: 200 len: 345 microversion: 2.1 time: 0.206568 May 13 14:54:03.305086 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 3/3] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 14:54:03 2022] GET /compute/v2.1/os-volumes/138ae64d-75c8-4169-b7f3-ae93c9acaf6f => generated 345 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:54:04.318895 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4b720b3b-b37e-428d-a00c-5e15f125cd07 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf497e09d0>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:04.478050 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4b720b3b-b37e-428d-a00c-5e15f125cd07 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/138ae64d-75c8-4169-b7f3-ae93c9acaf6f" status: 200 len: 346 microversion: 2.1 time: 0.165719 May 13 14:54:04.479252 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 4/4] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 14:54:04 2022] GET /compute/v2.1/os-volumes/138ae64d-75c8-4169-b7f3-ae93c9acaf6f => generated 346 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:04.491914 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-15775214-c23e-4d9f-a288-1ebd32aeec9e tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Action: 'create', calling method: .version_select at 0x7fcf497e6040>, body: {"snapshot": {"volume_id": "138ae64d-75c8-4169-b7f3-ae93c9acaf6f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1268412348"}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:04.903529 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-15775214-c23e-4d9f-a288-1ebd32aeec9e tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.416888 May 13 14:54:04.904155 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 5/5] 10.222.0.99 () {60 vars in 1161 bytes} [Fri May 13 14:54:04 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:54:04.913919 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-8444b7af-d8fe-4e20-97ed-a6467f90a728 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf497e0d30>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:05.067577 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-8444b7af-d8fe-4e20-97ed-a6467f90a728 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d" status: 200 len: 287 microversion: 2.1 time: 0.157212 May 13 14:54:05.068302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 6/6] 10.222.0.99 () {58 vars in 1250 bytes} [Fri May 13 14:54:04 2022] GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d => generated 287 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:54:05.093819 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-71ea0c44-b059-417b-b256-7d7b50499b4c tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf497e00d0>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:05.212588 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-71ea0c44-b059-417b-b256-7d7b50499b4c tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.137031 May 13 14:54:05.213351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 7/7] 10.222.0.99 () {58 vars in 1139 bytes} [Fri May 13 14:54:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:54:05.226304 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-489f337d-8dd8-4172-b39c-018d55d20200 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf497e6280>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:05.277561 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-489f337d-8dd8-4172-b39c-018d55d20200 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d" status: 200 len: 287 microversion: 2.1 time: 0.055416 May 13 14:54:05.278251 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 8/8] 10.222.0.99 () {58 vars in 1250 bytes} [Fri May 13 14:54:05 2022] GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:05.797486 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-a4ab2b4a-224b-4284-a354-8663e13e61a1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Flavor limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:54:05.797999 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-a4ab2b4a-224b-4284-a354-8663e13e61a1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Image limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:54:05.798371 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-a4ab2b4a-224b-4284-a354-8663e13e61a1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Flavor pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:54:05.798783 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-a4ab2b4a-224b-4284-a354-8663e13e61a1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Image pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:54:05.799189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-a4ab2b4a-224b-4284-a354-8663e13e61a1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:54:05.817245 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a4ab2b4a-224b-4284-a354-8663e13e61a1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:05.817946 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a4ab2b4a-224b-4284-a354-8663e13e61a1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:05.818934 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a4ab2b4a-224b-4284-a354-8663e13e61a1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:05.819339 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a4ab2b4a-224b-4284-a354-8663e13e61a1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:05.945005 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-a4ab2b4a-224b-4284-a354-8663e13e61a1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Getting quotas for project 8159266bb76747dc8687d5884241dd29. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:54:05.960154 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-a4ab2b4a-224b-4284-a354-8663e13e61a1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Getting quotas for user 461f929b4237427791b49ec3cb465091 and project 8159266bb76747dc8687d5884241dd29. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:54:05.979093 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a4ab2b4a-224b-4284-a354-8663e13e61a1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Going to run 1 instances... {{(pid=117296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:54:05.982515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a4ab2b4a-224b-4284-a354-8663e13e61a1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac0bc7b-d963-4624-aba3-a81fd1bf324c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:54:06.139793 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a4ab2b4a-224b-4284-a354-8663e13e61a1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.492583 May 13 14:54:06.140683 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 1/9] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 14:53:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 6495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:54:06.151203 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-be18324e-a64a-4468-b5b4-709aaa1ec934 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:06.152170 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-be18324e-a64a-4468-b5b4-709aaa1ec934 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:06.305452 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9a398445-0f78-4be1-b1fd-c6c8d578f454 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf4978b280>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:06.403306 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9a398445-0f78-4be1-b1fd-c6c8d578f454 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d" status: 200 len: 287 microversion: 2.1 time: 0.109700 May 13 14:54:06.407546 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 2/10] 10.222.0.99 () {58 vars in 1250 bytes} [Fri May 13 14:54:06 2022] GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:06.444114 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-be18324e-a64a-4468-b5b4-709aaa1ec934 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:06.506966 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-be18324e-a64a-4468-b5b4-709aaa1ec934 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1215 microversion: 2.1 time: 0.356943 May 13 14:54:06.510359 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 9/11] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:06 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1215 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:07.415054 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-46dfaf69-990a-41f2-9560-0653f0511d67 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf486eec10>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:07.468064 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-46dfaf69-990a-41f2-9560-0653f0511d67 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d" status: 200 len: 287 microversion: 2.1 time: 0.056997 May 13 14:54:07.470046 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 3/12] 10.222.0.99 () {58 vars in 1250 bytes} [Fri May 13 14:54:07 2022] GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:07.526357 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4dcebd34-94df-46d8-84bb-2df04dd0a2a8 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:07.527109 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4dcebd34-94df-46d8-84bb-2df04dd0a2a8 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:07.668826 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4dcebd34-94df-46d8-84bb-2df04dd0a2a8 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:07.679280 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4dcebd34-94df-46d8-84bb-2df04dd0a2a8 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1215 microversion: 2.1 time: 0.157761 May 13 14:54:07.682872 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 10/13] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:07 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:08.483548 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-97865c72-a939-408b-9bb3-0bb653c9f324 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf497b45e0>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:08.568312 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-97865c72-a939-408b-9bb3-0bb653c9f324 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d" status: 200 len: 287 microversion: 2.1 time: 0.090863 May 13 14:54:08.569945 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 11/14] 10.222.0.99 () {58 vars in 1250 bytes} [Fri May 13 14:54:08 2022] GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:54:08.592790 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-99f6fac0-1f2f-47cb-aed5-b8859034fe81 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Action: 'create', calling method: .version_select at 0x7fcf486fb280>, body: {"keypair": {"name": "tempest-keypair-453477896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzV1cMo9VyEBbaZSXdi95lCfH8rIm+ODTkE04nVQ7ORod/2X+z+YLNAxyHMh+FnMwoH4KP8Wle+ATmYd9xpkcZIS4P9H9druevWCI70dYKzXd5w5vYplFu90/MgaT8ajA=="}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:08.619615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-99f6fac0-1f2f-47cb-aed5-b8859034fe81 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Getting quotas for project 9d31191dfc694e3b94a6139dd2e9653f. Resources: {'key_pairs'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:54:08.624360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-99f6fac0-1f2f-47cb-aed5-b8859034fe81 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Getting quotas for user ac89928ac188406d910838be33a61c3e and project 9d31191dfc694e3b94a6139dd2e9653f. Resources: {'key_pairs'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:54:08.684018 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-99f6fac0-1f2f-47cb-aed5-b8859034fe81 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.352133 May 13 14:54:08.685690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 4/15] 10.222.0.99 () {62 vars in 1199 bytes} [Fri May 13 14:54:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 358 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 13 14:54:08.701350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e8805e1c-404e-4178-8e77-1a7949ca6ac5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:08.702311 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e8805e1c-404e-4178-8e77-1a7949ca6ac5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:08.715854 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e8805e1c-404e-4178-8e77-1a7949ca6ac5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:08.717025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e8805e1c-404e-4178-8e77-1a7949ca6ac5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:08.720206 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e8805e1c-404e-4178-8e77-1a7949ca6ac5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:08.720656 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e8805e1c-404e-4178-8e77-1a7949ca6ac5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:09.098414 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e8805e1c-404e-4178-8e77-1a7949ca6ac5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:09.124609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e8805e1c-404e-4178-8e77-1a7949ca6ac5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1219 microversion: 2.1 time: 0.419102 May 13 14:54:09.126880 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 12/16] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:08 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1219 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:09.583171 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ffc90572-0f36-4222-94ba-060e23b051f3 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf48708550>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:09.644654 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ffc90572-0f36-4222-94ba-060e23b051f3 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d" status: 200 len: 287 microversion: 2.1 time: 0.065940 May 13 14:54:09.646373 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 5/17] 10.222.0.99 () {58 vars in 1250 bytes} [Fri May 13 14:54:09 2022] GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:10.144789 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ec081eaf-394f-472a-9ae0-365d53dc7450 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:10.145853 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ec081eaf-394f-472a-9ae0-365d53dc7450 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:10.158148 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ec081eaf-394f-472a-9ae0-365d53dc7450 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:10.159256 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ec081eaf-394f-472a-9ae0-365d53dc7450 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:10.161631 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ec081eaf-394f-472a-9ae0-365d53dc7450 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:10.164052 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ec081eaf-394f-472a-9ae0-365d53dc7450 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:10.484739 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ec081eaf-394f-472a-9ae0-365d53dc7450 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:10.497233 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ec081eaf-394f-472a-9ae0-365d53dc7450 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1219 microversion: 2.1 time: 0.358193 May 13 14:54:10.497828 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 13/18] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:10 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1219 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:10.662522 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-eaac9021-184f-4355-a768-5c8b09eddd71 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf48708c10>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:10.769264 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-eaac9021-184f-4355-a768-5c8b09eddd71 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d" status: 200 len: 287 microversion: 2.1 time: 0.115681 May 13 14:54:10.770453 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 6/19] 10.222.0.99 () {58 vars in 1250 bytes} [Fri May 13 14:54:10 2022] GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:11.519932 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7fcdd2d2-6bb0-4884-867b-3b26d226cf58 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:11.521102 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7fcdd2d2-6bb0-4884-867b-3b26d226cf58 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:11.547634 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7fcdd2d2-6bb0-4884-867b-3b26d226cf58 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:11.548766 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7fcdd2d2-6bb0-4884-867b-3b26d226cf58 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:11.550224 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7fcdd2d2-6bb0-4884-867b-3b26d226cf58 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:11.550899 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7fcdd2d2-6bb0-4884-867b-3b26d226cf58 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:11.716976 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-306e1067-739e-4a76-8fe6-d58be1a6173f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Action: 'create', calling method: .version_select at 0x7fcf4972e310>, body: {"keypair": {"name": "tempest-keypair-925343145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5856Nvg2uSojklDEviXJ/92xh0NvWRFHFa5Kloc016G+uxtNnhXOFdHRPRhHCCDQ+pe8D4wboav+GvbCBUL+EFh/0UQkaHfYhlNzJXiVALjPPmTfpkoo+7ctsRb/L4sA=="}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:11.884605 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-306e1067-739e-4a76-8fe6-d58be1a6173f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Getting quotas for project 8ff6bdb0a99948698dc413c12b120b61. Resources: {'key_pairs'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:54:11.913521 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-306e1067-739e-4a76-8fe6-d58be1a6173f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Getting quotas for user 1ded6e90b10949dcb921119073f2d26a and project 8ff6bdb0a99948698dc413c12b120b61. Resources: {'key_pairs'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:54:12.059078 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-306e1067-739e-4a76-8fe6-d58be1a6173f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.641555 May 13 14:54:12.067446 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 14/20] 10.222.0.99 () {60 vars in 1158 bytes} [Fri May 13 14:54:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:12.080323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c3b991f8-e036-4b7b-9ce6-79a861482b42 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf496c3a60>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:12.136265 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c3b991f8-e036-4b7b-9ce6-79a861482b42 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d" status: 200 len: 288 microversion: 2.1 time: 0.058261 May 13 14:54:12.148774 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 15/21] 10.222.0.99 () {58 vars in 1250 bytes} [Fri May 13 14:54:12 2022] GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d => generated 288 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:12.162171 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-6134c27d-3783-48c7-ad9d-07e9e2c5e112 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf48e6f0d0>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:12.302566 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7fcdd2d2-6bb0-4884-867b-3b26d226cf58 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:12.367282 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7fcdd2d2-6bb0-4884-867b-3b26d226cf58 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1267 microversion: 2.1 time: 0.853638 May 13 14:54:12.368430 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 7/22] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:11 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1267 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:12.370997 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-6134c27d-3783-48c7-ad9d-07e9e2c5e112 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "DELETE /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d" status: 202 len: 0 microversion: 2.1 time: 0.218272 May 13 14:54:12.376523 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 16/23] 10.222.0.99 () {58 vars in 1253 bytes} [Fri May 13 14:54:12 2022] DELETE /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:54:12.385384 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b2612c7b-e1a4-427a-92d0-7a9a1eb50326 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf486504c0>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:12.446448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b2612c7b-e1a4-427a-92d0-7a9a1eb50326 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d" status: 200 len: 287 microversion: 2.1 time: 0.070260 May 13 14:54:12.447013 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 8/24] 10.222.0.99 () {58 vars in 1250 bytes} [Fri May 13 14:54:12 2022] GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:54:12.655476 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-a1d5216d-2f38-4d5a-b9f5-a2eeb63d447d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Action: 'create', calling method: .version_select at 0x7fcf48e6f700>, body: {"keypair": {"name": "tempest-keypair-1202549777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjnIt5sVXCSG9C3krIhAz0Otwh0F2BECnFtKfGNGqU3mYXiPvHsSJjMrxxYcGDFMguk8R5+RxKrx0yciEGuA53j35cMGhke3pQHwTZofG1AeOU6/6qy+2sLg49uF5DmTA=="}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:12.685959 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-a1d5216d-2f38-4d5a-b9f5-a2eeb63d447d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Getting quotas for project 634e7491dc6e43f98fb82baba250b09b. Resources: {'key_pairs'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:54:12.696838 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-a1d5216d-2f38-4d5a-b9f5-a2eeb63d447d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Getting quotas for user fbe6cc242fbf40cf8250dabaa336f648 and project 634e7491dc6e43f98fb82baba250b09b. Resources: {'key_pairs'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:54:12.755530 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-a1d5216d-2f38-4d5a-b9f5-a2eeb63d447d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179460 May 13 14:54:12.762693 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 17/25] 10.222.0.99 () {60 vars in 1158 bytes} [Fri May 13 14:54:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:54:13.386945 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-14bac01f-a013-4070-9f18-931f1c11da5e tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:13.387628 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-14bac01f-a013-4070-9f18-931f1c11da5e tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:13.442727 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-14bac01f-a013-4070-9f18-931f1c11da5e tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:13.444214 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-14bac01f-a013-4070-9f18-931f1c11da5e tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:13.447377 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-14bac01f-a013-4070-9f18-931f1c11da5e tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:13.448714 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-14bac01f-a013-4070-9f18-931f1c11da5e tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:13.480020 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-2ad976b2-7852-4599-be0d-f1ad5cc0cc6e tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf48e6f5e0>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:13.565004 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-2ad976b2-7852-4599-be0d-f1ad5cc0cc6e tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d" status: 200 len: 287 microversion: 2.1 time: 0.109864 May 13 14:54:13.570843 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 18/26] 10.222.0.99 () {58 vars in 1250 bytes} [Fri May 13 14:54:13 2022] GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d => generated 287 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:54:13.618785 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-14bac01f-a013-4070-9f18-931f1c11da5e tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:13.633069 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-14bac01f-a013-4070-9f18-931f1c11da5e tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1267 microversion: 2.1 time: 0.248100 May 13 14:54:13.640582 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 9/27] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:13 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1267 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:14.578737 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-04a9b069-5686-4a22-9cc8-36a7c4019d04 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf496c3f70>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:14.641416 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-04a9b069-5686-4a22-9cc8-36a7c4019d04 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d" status: 200 len: 287 microversion: 2.1 time: 0.066929 May 13 14:54:14.645994 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 19/28] 10.222.0.99 () {58 vars in 1250 bytes} [Fri May 13 14:54:14 2022] GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:14.653141 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-caf79804-71fb-4d47-bc78-7da1d955b1a8 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:14.653767 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-caf79804-71fb-4d47-bc78-7da1d955b1a8 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:14.664675 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-caf79804-71fb-4d47-bc78-7da1d955b1a8 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:14.665123 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-caf79804-71fb-4d47-bc78-7da1d955b1a8 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:14.665917 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-caf79804-71fb-4d47-bc78-7da1d955b1a8 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:14.670703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-caf79804-71fb-4d47-bc78-7da1d955b1a8 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:15.034212 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c9f0caac-9d6f-4505-8c57-c16092f71896 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-752389759", "imageRef": "eac0bc7b-d963-4624-aba3-a81fd1bf324c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c888f077-916d-48b7-a870-8fa454d08ec4"}], "security_groups": [{"name": "tempest-securitygroup--1105753955"}], "key_name": "tempest-keypair-453477896", "user_data": "}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:15.282206 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-caf79804-71fb-4d47-bc78-7da1d955b1a8 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:15.291280 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-caf79804-71fb-4d47-bc78-7da1d955b1a8 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1267 microversion: 2.1 time: 0.643027 May 13 14:54:15.292213 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 10/29] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:14 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1267 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:15.351592 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-4cd2fd0e-0c90-4a5d-adae-0fcb165b466b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1869227634", "imageRef": "eac0bc7b-d963-4624-aba3-a81fd1bf324c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:15.384693 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.network.neutron [None req-c9f0caac-9d6f-4505-8c57-c16092f71896 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] validate_networks() for [('c888f077-916d-48b7-a870-8fa454d08ec4', None, None, None, None, None)] {{(pid=117295) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:54:15.412413 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.network.neutron [None req-4cd2fd0e-0c90-4a5d-adae-0fcb165b466b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] validate_networks() for [('5a7b2298-9e34-420b-b30f-2b0ff9798ff9', None, None, None, None, None)] {{(pid=117296) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:54:17.136683 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-4cd2fd0e-0c90-4a5d-adae-0fcb165b466b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Flavor limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:54:17.137359 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-4cd2fd0e-0c90-4a5d-adae-0fcb165b466b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Image limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:54:17.137569 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-4cd2fd0e-0c90-4a5d-adae-0fcb165b466b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Flavor pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:54:17.137981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-4cd2fd0e-0c90-4a5d-adae-0fcb165b466b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Image pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:54:17.138637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-4cd2fd0e-0c90-4a5d-adae-0fcb165b466b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:54:17.168271 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4cd2fd0e-0c90-4a5d-adae-0fcb165b466b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:17.169091 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4cd2fd0e-0c90-4a5d-adae-0fcb165b466b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:17.169940 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4cd2fd0e-0c90-4a5d-adae-0fcb165b466b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:17.170379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4cd2fd0e-0c90-4a5d-adae-0fcb165b466b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:17.210698 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-4cd2fd0e-0c90-4a5d-adae-0fcb165b466b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Getting quotas for project 55a6554838094ba8a8b807bd90ec5bf4. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:54:17.217010 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-4cd2fd0e-0c90-4a5d-adae-0fcb165b466b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Getting quotas for user 18907451ac014573ba51f5f5f3939381 and project 55a6554838094ba8a8b807bd90ec5bf4. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:54:17.236577 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-4cd2fd0e-0c90-4a5d-adae-0fcb165b466b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Going to run 1 instances... {{(pid=117296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:54:17.239629 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-4cd2fd0e-0c90-4a5d-adae-0fcb165b466b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac0bc7b-d963-4624-aba3-a81fd1bf324c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:54:17.314320 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-4cd2fd0e-0c90-4a5d-adae-0fcb165b466b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.020484 May 13 14:54:17.316094 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 11/30] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 14:54:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 2023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:54:17.340674 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a84259b8-2a9e-4f4a-9d5e-5d39730ee216 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf48604430>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:17.396268 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-a84259b8-2a9e-4f4a-9d5e-5d39730ee216 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] HTTP exception thrown: Snapshot 561da9e4-cac2-4513-856e-7ac90a63a07d could not be found. May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a84259b8-2a9e-4f4a-9d5e-5d39730ee216 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Request method failure captured: May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d HTTP/1.1 May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnEFlR4sOe8AjErJwFdo7aUJF0ctUZW0tQ0rYj2DJPPYRy7qRr_W80fZt6j0-WyD0BDOppSoPdX-sgGlAZ5L4wubXLC5jn6qVrrbFvllLGpI_-xcxGU3j88szUragt6w07j2RqaQd7-VBZMdCjrhMNhQtDJXtCcs4rnulk3QVIN8Qto May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 1f1f4557b8bd4360ae6eb609fcd7f2ce May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-181677404 May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 14:54:17.402608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 14:54:17.404083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_1f1f4557b8bd4360ae6eb609fcd7f2ce", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1f1f4557b8bd4360ae6eb609fcd7f2ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1f1f4557b8bd4360ae6eb609fcd7f2ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/1f1f4557b8bd4360ae6eb609fcd7f2ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:54:17.404083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-VolumesSnapshotsTestJSON-181677404 May 13 14:54:17.404083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 1f1f4557b8bd4360ae6eb609fcd7f2ce May 13 14:54:17.404083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-181677404 May 13 14:54:17.404083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-VolumesSnapshotsTestJSON-181677404-project May 13 14:54:17.404083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 14:54:17.404083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 14:54:17.404083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: 2578ccb10b284a49a5336f9eb57f3cc4 May 13 14:54:17.404083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-VolumesSnapshotsTestJSON-181677404-project May 13 14:54:17.404083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: May 13 14:54:17.404083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Snapshot 561da9e4-cac2-4513-856e-7ac90a63a07d could not be found. May 13 14:54:17.404083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': '561da9e4-cac2-4513-856e-7ac90a63a07d'} May 13 14:54:17.404083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 561da9e4-cac2-4513-856e-7ac90a63a07d could not be found. (HTTP 404) (Request-ID: req-a79e9003-7391-4a14-8251-998391c708db) May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:54:17.404978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:54:17.406212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 561da9e4-cac2-4513-856e-7ac90a63a07d could not be found. May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 13 14:54:17.407353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:54:17.409602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 561da9e4-cac2-4513-856e-7ac90a63a07d could not be found. May 13 14:54:17.409602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:54:17.409602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:54:17.409602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:54:17.409602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:54:17.409602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:54:17.409602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:54:17.409602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:54:17.409602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:54:17.409602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 561da9e4-cac2-4513-856e-7ac90a63a07d could not be found. May 13 14:54:17.409602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:54:17.412021 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a84259b8-2a9e-4f4a-9d5e-5d39730ee216 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Returning 404 to user: Snapshot 561da9e4-cac2-4513-856e-7ac90a63a07d could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:54:17.412610 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a84259b8-2a9e-4f4a-9d5e-5d39730ee216 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d" status: 404 len: 111 microversion: 2.1 time: 0.090381 May 13 14:54:17.413320 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 12/31] 10.222.0.99 () {58 vars in 1250 bytes} [Fri May 13 14:54:17 2022] GET /compute/v2.1/os-snapshots/561da9e4-cac2-4513-856e-7ac90a63a07d => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:54:17.427429 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1bbb680b-e04e-49c3-a4da-41c35fb64db1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:17.428115 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1bbb680b-e04e-49c3-a4da-41c35fb64db1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:17.435721 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1bbb680b-e04e-49c3-a4da-41c35fb64db1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:17.436664 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1bbb680b-e04e-49c3-a4da-41c35fb64db1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:17.437696 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1bbb680b-e04e-49c3-a4da-41c35fb64db1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:17.438551 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1bbb680b-e04e-49c3-a4da-41c35fb64db1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:17.792072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1bbb680b-e04e-49c3-a4da-41c35fb64db1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:17.803974 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1bbb680b-e04e-49c3-a4da-41c35fb64db1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1273 microversion: 2.1 time: 0.385280 May 13 14:54:17.805682 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 13/32] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:17 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1273 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:17.823512 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a580609b-b401-4a38-9be7-febffdd9d9b1 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1277149243", "imageRef": "eac0bc7b-d963-4624-aba3-a81fd1bf324c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d5b153a-6477-4cd2-b1f3-e03c30c658fe"}], "security_groups": [{"name": "tempest-securitygroup--2122305796"}], "key_name": "tempest-keypair-1202549777", "user_data": "}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:18.060762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-c9f0caac-9d6f-4505-8c57-c16092f71896 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Flavor limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:54:18.061295 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-c9f0caac-9d6f-4505-8c57-c16092f71896 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Image limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:54:18.061951 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-c9f0caac-9d6f-4505-8c57-c16092f71896 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Flavor pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:54:18.062530 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-c9f0caac-9d6f-4505-8c57-c16092f71896 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Image pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:54:18.071257 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-c9f0caac-9d6f-4505-8c57-c16092f71896 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:54:18.101244 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c9f0caac-9d6f-4505-8c57-c16092f71896 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:18.110609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c9f0caac-9d6f-4505-8c57-c16092f71896 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:18.114957 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c9f0caac-9d6f-4505-8c57-c16092f71896 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:18.116548 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c9f0caac-9d6f-4505-8c57-c16092f71896 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:18.212370 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-c9f0caac-9d6f-4505-8c57-c16092f71896 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Getting quotas for project 9d31191dfc694e3b94a6139dd2e9653f. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:54:18.227607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-c9f0caac-9d6f-4505-8c57-c16092f71896 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Getting quotas for user ac89928ac188406d910838be33a61c3e and project 9d31191dfc694e3b94a6139dd2e9653f. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:54:18.267099 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c9f0caac-9d6f-4505-8c57-c16092f71896 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Going to run 1 instances... {{(pid=117295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:54:18.275444 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c9f0caac-9d6f-4505-8c57-c16092f71896 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac0bc7b-d963-4624-aba3-a81fd1bf324c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:54:18.540752 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.network.neutron [None req-a580609b-b401-4a38-9be7-febffdd9d9b1 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] validate_networks() for [('8d5b153a-6477-4cd2-b1f3-e03c30c658fe', None, None, None, None, None)] {{(pid=117296) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:54:18.617605 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c9f0caac-9d6f-4505-8c57-c16092f71896 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.585961 May 13 14:54:18.620068 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 20/33] 10.222.0.99 () {62 vars in 1187 bytes} [Fri May 13 14:54:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 3592 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 13 14:54:18.645528 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4489622f-aceb-4c61-958b-702551864769 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:18.652950 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4489622f-aceb-4c61-958b-702551864769 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:18.984143 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4489622f-aceb-4c61-958b-702551864769 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:18.993956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4489622f-aceb-4c61-958b-702551864769 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1222 microversion: 2.1 time: 0.371505 May 13 14:54:19.002874 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 21/34] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:18 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1222 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:19.060750 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-76189501-ac5e-497d-b164-f8db05db7d13 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf48e065e0>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:19.389758 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-76189501-ac5e-497d-b164-f8db05db7d13 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/138ae64d-75c8-4169-b7f3-ae93c9acaf6f" status: 202 len: 0 microversion: 2.1 time: 0.381569 May 13 14:54:19.391261 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 22/35] 10.222.0.99 () {58 vars in 1247 bytes} [Fri May 13 14:54:19 2022] DELETE /compute/v2.1/os-volumes/138ae64d-75c8-4169-b7f3-ae93c9acaf6f => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:54:19.400507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d0d726a5-a9f3-4107-b94c-4cc91077175f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:19.401201 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d0d726a5-a9f3-4107-b94c-4cc91077175f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:19.641814 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d0d726a5-a9f3-4107-b94c-4cc91077175f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:19.655631 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d0d726a5-a9f3-4107-b94c-4cc91077175f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:19.658702 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d0d726a5-a9f3-4107-b94c-4cc91077175f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:19.662304 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d0d726a5-a9f3-4107-b94c-4cc91077175f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1280 microversion: 2.20 time: 0.266695 May 13 14:54:19.667354 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 23/36] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:19 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1280 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:19.682571 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-34fee41a-daf5-4e0d-9271-491c986592cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2118064978", "imageRef": "eac0bc7b-d963-4624-aba3-a81fd1bf324c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "316a8fad-500e-494b-ad63-b6f37981c2d9"}], "security_groups": [{"name": "tempest-securitygroup--1330365826"}], "key_name": "tempest-keypair-925343145", "user_data": "}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:20.102478 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.network.neutron [None req-34fee41a-daf5-4e0d-9271-491c986592cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] validate_networks() for [('316a8fad-500e-494b-ad63-b6f37981c2d9', None, None, None, None, None)] {{(pid=117295) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:54:20.292905 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-a580609b-b401-4a38-9be7-febffdd9d9b1 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Flavor limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:54:20.293547 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-a580609b-b401-4a38-9be7-febffdd9d9b1 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Image limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:54:20.294133 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-a580609b-b401-4a38-9be7-febffdd9d9b1 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Flavor pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:54:20.294795 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-a580609b-b401-4a38-9be7-febffdd9d9b1 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Image pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:54:20.295369 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-a580609b-b401-4a38-9be7-febffdd9d9b1 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:54:20.314157 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a580609b-b401-4a38-9be7-febffdd9d9b1 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:20.316821 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a580609b-b401-4a38-9be7-febffdd9d9b1 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:20.318031 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a580609b-b401-4a38-9be7-febffdd9d9b1 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:20.320194 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a580609b-b401-4a38-9be7-febffdd9d9b1 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:20.422661 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-a580609b-b401-4a38-9be7-febffdd9d9b1 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Getting quotas for project 634e7491dc6e43f98fb82baba250b09b. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:54:20.444689 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-a580609b-b401-4a38-9be7-febffdd9d9b1 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Getting quotas for user fbe6cc242fbf40cf8250dabaa336f648 and project 634e7491dc6e43f98fb82baba250b09b. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:54:20.496701 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a580609b-b401-4a38-9be7-febffdd9d9b1 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Going to run 1 instances... {{(pid=117296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:54:20.505860 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a580609b-b401-4a38-9be7-febffdd9d9b1 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac0bc7b-d963-4624-aba3-a81fd1bf324c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:54:20.705127 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a580609b-b401-4a38-9be7-febffdd9d9b1 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.896045 May 13 14:54:20.712825 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 14/37] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 14:54:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 2906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:54:20.751711 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9b196eba-1b00-4ee2-a5a5-f42c8b612447 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:20.752493 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-9b196eba-1b00-4ee2-a5a5-f42c8b612447 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:20.783516 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9b196eba-1b00-4ee2-a5a5-f42c8b612447 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:20.784183 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9b196eba-1b00-4ee2-a5a5-f42c8b612447 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:20.788746 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9b196eba-1b00-4ee2-a5a5-f42c8b612447 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:20.802747 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9b196eba-1b00-4ee2-a5a5-f42c8b612447 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:21.705270 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-34fee41a-daf5-4e0d-9271-491c986592cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Flavor limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:54:21.706561 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-34fee41a-daf5-4e0d-9271-491c986592cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Image limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:54:21.707229 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-34fee41a-daf5-4e0d-9271-491c986592cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Flavor pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:54:21.707848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-34fee41a-daf5-4e0d-9271-491c986592cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Image pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:54:21.708589 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-34fee41a-daf5-4e0d-9271-491c986592cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:54:21.711333 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9b196eba-1b00-4ee2-a5a5-f42c8b612447 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:21.730604 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-34fee41a-daf5-4e0d-9271-491c986592cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:21.735921 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9b196eba-1b00-4ee2-a5a5-f42c8b612447 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 1.021791 May 13 14:54:21.736220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-34fee41a-daf5-4e0d-9271-491c986592cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:21.738789 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-34fee41a-daf5-4e0d-9271-491c986592cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:21.743581 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-34fee41a-daf5-4e0d-9271-491c986592cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:21.749653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 15/38] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:20 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:21.755105 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c9c7a399-0879-4bc6-9adc-c9845d474c2d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-325984878", "imageRef": "eac0bc7b-d963-4624-aba3-a81fd1bf324c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:21.828733 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-34fee41a-daf5-4e0d-9271-491c986592cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Getting quotas for project 8ff6bdb0a99948698dc413c12b120b61. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:54:21.838048 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-34fee41a-daf5-4e0d-9271-491c986592cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Getting quotas for user 1ded6e90b10949dcb921119073f2d26a and project 8ff6bdb0a99948698dc413c12b120b61. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:54:21.889876 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.network.neutron [None req-c9c7a399-0879-4bc6-9adc-c9845d474c2d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] validate_networks() for [('5a7b2298-9e34-420b-b30f-2b0ff9798ff9', None, None, None, None, None)] {{(pid=117296) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:54:21.890111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-34fee41a-daf5-4e0d-9271-491c986592cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Going to run 1 instances... {{(pid=117295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:54:21.893710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-34fee41a-daf5-4e0d-9271-491c986592cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac0bc7b-d963-4624-aba3-a81fd1bf324c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:54:22.059469 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-34fee41a-daf5-4e0d-9271-491c986592cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.389020 May 13 14:54:22.083468 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 24/39] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 14:54:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 2410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:54:22.095439 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-91b204c6-8b68-43b5-a558-45334be673b1 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf48e06310>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:22.198736 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-91b204c6-8b68-43b5-a558-45334be673b1 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] HTTP exception thrown: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-91b204c6-8b68-43b5-a558-45334be673b1 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Request method failure captured: May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/os-volumes/138ae64d-75c8-4169-b7f3-ae93c9acaf6f HTTP/1.1 May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnEFlR4sOe8AjErJwFdo7aUJF0ctUZW0tQ0rYj2DJPPYRy7qRr_W80fZt6j0-WyD0BDOppSoPdX-sgGlAZ5L4wubXLC5jn6qVrrbFvllLGpI_-xcxGU3j88szUragt6w07j2RqaQd7-VBZMdCjrhMNhQtDJXtCcs4rnulk3QVIN8Qto May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 1f1f4557b8bd4360ae6eb609fcd7f2ce May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-181677404 May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 14:54:22.206735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 14:54:22.208158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_1f1f4557b8bd4360ae6eb609fcd7f2ce", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1f1f4557b8bd4360ae6eb609fcd7f2ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1f1f4557b8bd4360ae6eb609fcd7f2ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/1f1f4557b8bd4360ae6eb609fcd7f2ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:54:22.208158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-VolumesSnapshotsTestJSON-181677404 May 13 14:54:22.208158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 1f1f4557b8bd4360ae6eb609fcd7f2ce May 13 14:54:22.208158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-181677404 May 13 14:54:22.208158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-VolumesSnapshotsTestJSON-181677404-project May 13 14:54:22.208158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 14:54:22.208158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 14:54:22.208158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 2578ccb10b284a49a5336f9eb57f3cc4 May 13 14:54:22.208158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-VolumesSnapshotsTestJSON-181677404-project May 13 14:54:22.208158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: May 13 14:54:22.208158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. May 13 14:54:22.208158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '138ae64d-75c8-4169-b7f3-ae93c9acaf6f'} May 13 14:54:22.208158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. (HTTP 404) (Request-ID: req-9475fe59-5126-438e-96ae-30cf7df0dc0d) May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:54:22.208972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:54:22.210422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 14:54:22.211609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:54:22.213189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. May 13 14:54:22.213189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:54:22.213189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:54:22.213189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:54:22.213189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:54:22.213189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:54:22.213189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:54:22.213189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:54:22.213189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:54:22.213189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. May 13 14:54:22.213189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:54:22.214157 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-91b204c6-8b68-43b5-a558-45334be673b1 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Returning 404 to user: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:54:22.220935 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-91b204c6-8b68-43b5-a558-45334be673b1 tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/138ae64d-75c8-4169-b7f3-ae93c9acaf6f" status: 404 len: 109 microversion: 2.1 time: 0.139853 May 13 14:54:22.221681 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 25/40] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 14:54:22 2022] GET /compute/v2.1/os-volumes/138ae64d-75c8-4169-b7f3-ae93c9acaf6f => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:54:22.244202 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-678af7da-124a-4d9f-bcf2-dc2542f18434 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:22.246541 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-678af7da-124a-4d9f-bcf2-dc2542f18434 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:22.273941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-678af7da-124a-4d9f-bcf2-dc2542f18434 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:22.285701 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-678af7da-124a-4d9f-bcf2-dc2542f18434 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:22.287211 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-678af7da-124a-4d9f-bcf2-dc2542f18434 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:22.288603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-678af7da-124a-4d9f-bcf2-dc2542f18434 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:22.803894 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-678af7da-124a-4d9f-bcf2-dc2542f18434 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:22.817887 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-678af7da-124a-4d9f-bcf2-dc2542f18434 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:22.819969 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-678af7da-124a-4d9f-bcf2-dc2542f18434 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:22.828831 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-678af7da-124a-4d9f-bcf2-dc2542f18434 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1332 microversion: 2.20 time: 0.598840 May 13 14:54:22.831686 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 26/41] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:22 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1332 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:22.845312 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-bd50b5a9-c880-4db9-9b7b-de077bdb5d81 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:22.849302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-bd50b5a9-c880-4db9-9b7b-de077bdb5d81 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:22.867034 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bd50b5a9-c880-4db9-9b7b-de077bdb5d81 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:22.867679 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bd50b5a9-c880-4db9-9b7b-de077bdb5d81 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:22.869229 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bd50b5a9-c880-4db9-9b7b-de077bdb5d81 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:22.872295 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bd50b5a9-c880-4db9-9b7b-de077bdb5d81 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:23.184507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-bd50b5a9-c880-4db9-9b7b-de077bdb5d81 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:23.197534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-bd50b5a9-c880-4db9-9b7b-de077bdb5d81 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1234 microversion: 2.1 time: 0.363939 May 13 14:54:23.201301 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 27/42] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:22 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1234 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:23.217817 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-6824a80b-29ae-4ba7-9a31-23eed30fcf5f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:23.226171 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-6824a80b-29ae-4ba7-9a31-23eed30fcf5f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:23.402393 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-6824a80b-29ae-4ba7-9a31-23eed30fcf5f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:23.413343 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-6824a80b-29ae-4ba7-9a31-23eed30fcf5f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1241 microversion: 2.1 time: 0.207303 May 13 14:54:23.432229 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 28/43] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:23 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1241 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:23.437332 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f33d9a62-3872-4d0b-abe4-c46fb160d3fd tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf48590550>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:23.507011 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-f33d9a62-3872-4d0b-abe4-c46fb160d3fd tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] HTTP exception thrown: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f33d9a62-3872-4d0b-abe4-c46fb160d3fd tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Request method failure captured: May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: DELETE /compute/v2.1/os-volumes/138ae64d-75c8-4169-b7f3-ae93c9acaf6f HTTP/1.1 May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnEFlR4sOe8AjErJwFdo7aUJF0ctUZW0tQ0rYj2DJPPYRy7qRr_W80fZt6j0-WyD0BDOppSoPdX-sgGlAZ5L4wubXLC5jn6qVrrbFvllLGpI_-xcxGU3j88szUragt6w07j2RqaQd7-VBZMdCjrhMNhQtDJXtCcs4rnulk3QVIN8Qto May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 1f1f4557b8bd4360ae6eb609fcd7f2ce May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-181677404 May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 14:54:23.509282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 14:54:23.511501 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_1f1f4557b8bd4360ae6eb609fcd7f2ce", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1f1f4557b8bd4360ae6eb609fcd7f2ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1f1f4557b8bd4360ae6eb609fcd7f2ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/1f1f4557b8bd4360ae6eb609fcd7f2ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:54:23.511501 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-VolumesSnapshotsTestJSON-181677404 May 13 14:54:23.511501 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 1f1f4557b8bd4360ae6eb609fcd7f2ce May 13 14:54:23.511501 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-181677404 May 13 14:54:23.511501 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-VolumesSnapshotsTestJSON-181677404-project May 13 14:54:23.511501 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 14:54:23.511501 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 14:54:23.511501 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 2578ccb10b284a49a5336f9eb57f3cc4 May 13 14:54:23.511501 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-VolumesSnapshotsTestJSON-181677404-project May 13 14:54:23.511501 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: May 13 14:54:23.511501 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. May 13 14:54:23.511501 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '138ae64d-75c8-4169-b7f3-ae93c9acaf6f'} May 13 14:54:23.511501 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. (HTTP 404) (Request-ID: req-9d855d79-2668-401b-992f-52bb2c89f9c5) May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:54:23.512941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 14:54:23.514093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 14:54:23.518158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:54:23.521648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. May 13 14:54:23.521648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:54:23.521648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:54:23.521648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:54:23.521648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:54:23.521648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:54:23.521648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:54:23.521648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:54:23.521648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:54:23.521648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. May 13 14:54:23.521648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:54:23.521648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f33d9a62-3872-4d0b-abe4-c46fb160d3fd tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Returning 404 to user: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:54:23.521648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f33d9a62-3872-4d0b-abe4-c46fb160d3fd tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/138ae64d-75c8-4169-b7f3-ae93c9acaf6f" status: 404 len: 109 microversion: 2.1 time: 0.077696 May 13 14:54:23.521648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 29/44] 10.222.0.99 () {58 vars in 1247 bytes} [Fri May 13 14:54:23 2022] DELETE /compute/v2.1/os-volumes/138ae64d-75c8-4169-b7f3-ae93c9acaf6f => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:54:23.523846 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-2aeec82c-a08c-437a-a515-f99f562559be tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:23.524499 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-2aeec82c-a08c-437a-a515-f99f562559be tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:23.548696 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2aeec82c-a08c-437a-a515-f99f562559be tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:23.549151 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2aeec82c-a08c-437a-a515-f99f562559be tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:23.549947 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2aeec82c-a08c-437a-a515-f99f562559be tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:23.550383 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2aeec82c-a08c-437a-a515-f99f562559be tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:24.423728 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-c9c7a399-0879-4bc6-9adc-c9845d474c2d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Flavor limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:54:24.424435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-c9c7a399-0879-4bc6-9adc-c9845d474c2d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Image limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:54:24.424884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-c9c7a399-0879-4bc6-9adc-c9845d474c2d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Flavor pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:54:24.425724 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-c9c7a399-0879-4bc6-9adc-c9845d474c2d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Image pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:54:24.426652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-c9c7a399-0879-4bc6-9adc-c9845d474c2d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:54:24.453593 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c9c7a399-0879-4bc6-9adc-c9845d474c2d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:24.469087 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c9c7a399-0879-4bc6-9adc-c9845d474c2d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:24.471709 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c9c7a399-0879-4bc6-9adc-c9845d474c2d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:24.474792 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c9c7a399-0879-4bc6-9adc-c9845d474c2d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:24.633140 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-c9c7a399-0879-4bc6-9adc-c9845d474c2d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Getting quotas for project 55a6554838094ba8a8b807bd90ec5bf4. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:54:24.670714 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-c9c7a399-0879-4bc6-9adc-c9845d474c2d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Getting quotas for user 18907451ac014573ba51f5f5f3939381 and project 55a6554838094ba8a8b807bd90ec5bf4. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:54:24.748943 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c9c7a399-0879-4bc6-9adc-c9845d474c2d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Going to run 1 instances... {{(pid=117296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:54:24.752277 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c9c7a399-0879-4bc6-9adc-c9845d474c2d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac0bc7b-d963-4624-aba3-a81fd1bf324c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:54:24.841825 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-2aeec82c-a08c-437a-a515-f99f562559be tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:24.878083 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-2aeec82c-a08c-437a-a515-f99f562559be tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 1.364920 May 13 14:54:24.882685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 30/45] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:23 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:25.002357 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c9c7a399-0879-4bc6-9adc-c9845d474c2d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.250975 May 13 14:54:25.003568 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 16/46] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 14:54:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 3254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:54:25.009910 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-0a0eb355-3cef-4b18-b92b-38a8d3fe581c tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Calling method '.version_select at 0x7fcf486503a0>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:25.070030 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-0a0eb355-3cef-4b18-b92b-38a8d3fe581c tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] HTTP exception thrown: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-0a0eb355-3cef-4b18-b92b-38a8d3fe581c tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Request method failure captured: May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: GET /compute/v2.1/os-volumes/138ae64d-75c8-4169-b7f3-ae93c9acaf6f HTTP/1.1 May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnEFlR4sOe8AjErJwFdo7aUJF0ctUZW0tQ0rYj2DJPPYRy7qRr_W80fZt6j0-WyD0BDOppSoPdX-sgGlAZ5L4wubXLC5jn6qVrrbFvllLGpI_-xcxGU3j88szUragt6w07j2RqaQd7-VBZMdCjrhMNhQtDJXtCcs4rnulk3QVIN8Qto May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 1f1f4557b8bd4360ae6eb609fcd7f2ce May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-181677404 May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 14:54:25.073666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 14:54:25.075448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_1f1f4557b8bd4360ae6eb609fcd7f2ce", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1f1f4557b8bd4360ae6eb609fcd7f2ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/1f1f4557b8bd4360ae6eb609fcd7f2ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/1f1f4557b8bd4360ae6eb609fcd7f2ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:54:25.075448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-VolumesSnapshotsTestJSON-181677404 May 13 14:54:25.075448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 1f1f4557b8bd4360ae6eb609fcd7f2ce May 13 14:54:25.075448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-181677404 May 13 14:54:25.075448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-VolumesSnapshotsTestJSON-181677404-project May 13 14:54:25.075448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 14:54:25.075448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 14:54:25.075448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: 2578ccb10b284a49a5336f9eb57f3cc4 May 13 14:54:25.075448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-VolumesSnapshotsTestJSON-181677404-project May 13 14:54:25.075448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: May 13 14:54:25.075448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. May 13 14:54:25.075448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': '138ae64d-75c8-4169-b7f3-ae93c9acaf6f'} May 13 14:54:25.075448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. (HTTP 404) (Request-ID: req-4bf9e19a-61da-422a-8d14-24c9c187c12f) May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:54:25.076375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:54:25.077692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 14:54:25.079637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:54:25.080958 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. May 13 14:54:25.080958 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:54:25.080958 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:54:25.080958 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:54:25.080958 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:54:25.080958 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:54:25.080958 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:54:25.080958 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:54:25.080958 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:54:25.080958 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. May 13 14:54:25.080958 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:54:25.083240 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-0a0eb355-3cef-4b18-b92b-38a8d3fe581c tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] Returning 404 to user: Volume 138ae64d-75c8-4169-b7f3-ae93c9acaf6f could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:54:25.085872 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-0a0eb355-3cef-4b18-b92b-38a8d3fe581c tempest-VolumesSnapshotsTestJSON-181677404 tempest-VolumesSnapshotsTestJSON-181677404-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/138ae64d-75c8-4169-b7f3-ae93c9acaf6f" status: 404 len: 109 microversion: 2.1 time: 0.079594 May 13 14:54:25.087170 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 17/47] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 14:54:25 2022] GET /compute/v2.1/os-volumes/138ae64d-75c8-4169-b7f3-ae93c9acaf6f => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:54:25.108026 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-2188582b-7533-45f4-8534-e8d21e0832e5 req-be067bb7-b27e-4078-92ab-bd8e5a0fecc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1542a35b-8d51-4329-89e1-e68453edcb61", "tag": "b9563ab0-d4b8-426f-af56-b221edbff1ee"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:25.122665 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3e9d0934-acd6-4dbf-b21d-97c81378ca04 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:25.123477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-3e9d0934-acd6-4dbf-b21d-97c81378ca04 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:25.163012 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-2188582b-7533-45f4-8534-e8d21e0832e5 req-be067bb7-b27e-4078-92ab-bd8e5a0fecc5 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:25.164243 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3e9d0934-acd6-4dbf-b21d-97c81378ca04 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:25.164659 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-2188582b-7533-45f4-8534-e8d21e0832e5 req-be067bb7-b27e-4078-92ab-bd8e5a0fecc5 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:25.165341 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3e9d0934-acd6-4dbf-b21d-97c81378ca04 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:25.167908 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3e9d0934-acd6-4dbf-b21d-97c81378ca04 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:25.169242 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3e9d0934-acd6-4dbf-b21d-97c81378ca04 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:25.246651 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-2188582b-7533-45f4-8534-e8d21e0832e5 req-be067bb7-b27e-4078-92ab-bd8e5a0fecc5 service nova] Creating event network-changed:b9563ab0-d4b8-426f-af56-b221edbff1ee for instance 1542a35b-8d51-4329-89e1-e68453edcb61 on hv-cinder-83090 May 13 14:54:25.248359 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-2188582b-7533-45f4-8534-e8d21e0832e5 req-be067bb7-b27e-4078-92ab-bd8e5a0fecc5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117295) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 13 14:54:25.249620 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf6f6d8e-a24e-4066-b1f2-0020d81e37ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:25.256008 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf6f6d8e-a24e-4066-b1f2-0020d81e37ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:25.262337 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf6f6d8e-a24e-4066-b1f2-0020d81e37ea None None] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:25.265993 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf6f6d8e-a24e-4066-b1f2-0020d81e37ea None None] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:25.340337 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.compute.rpcapi [None req-bf6f6d8e-a24e-4066-b1f2-0020d81e37ea None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 13 14:54:25.346992 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf6f6d8e-a24e-4066-b1f2-0020d81e37ea None None] Releasing lock "compute-rpcapi-router" {{(pid=117295) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 13 14:54:25.411363 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-bf6f6d8e-a24e-4066-b1f2-0020d81e37ea None None] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.520524 May 13 14:54:25.412034 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 31/48] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:25.424575 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-236e7b10-ca4f-4b79-b362-e3f7487294b0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:25.425296 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-236e7b10-ca4f-4b79-b362-e3f7487294b0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:25.466047 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-236e7b10-ca4f-4b79-b362-e3f7487294b0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:25.466910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-236e7b10-ca4f-4b79-b362-e3f7487294b0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:25.472316 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-236e7b10-ca4f-4b79-b362-e3f7487294b0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:25.475008 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-236e7b10-ca4f-4b79-b362-e3f7487294b0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:25.710649 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3e9d0934-acd6-4dbf-b21d-97c81378ca04 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:25.719518 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3e9d0934-acd6-4dbf-b21d-97c81378ca04 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:25.721081 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3e9d0934-acd6-4dbf-b21d-97c81378ca04 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:25.734003 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-3e9d0934-acd6-4dbf-b21d-97c81378ca04 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1338 microversion: 2.20 time: 0.633696 May 13 14:54:25.735060 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 18/49] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:25 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1338 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:25.761528 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-d7683f40-b33c-4afb-a6a4-d126b2391e27 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:25.770098 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-d7683f40-b33c-4afb-a6a4-d126b2391e27 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:25.797448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d7683f40-b33c-4afb-a6a4-d126b2391e27 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:25.798203 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d7683f40-b33c-4afb-a6a4-d126b2391e27 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:25.804887 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d7683f40-b33c-4afb-a6a4-d126b2391e27 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:25.808009 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d7683f40-b33c-4afb-a6a4-d126b2391e27 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:26.244582 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-236e7b10-ca4f-4b79-b362-e3f7487294b0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:26.255048 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-236e7b10-ca4f-4b79-b362-e3f7487294b0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1296 microversion: 2.1 time: 0.840714 May 13 14:54:26.257629 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 32/50] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:25 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1296 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:26.272594 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ca3bfd57-ec19-4833-90a1-b0acd96bb182 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:26.275622 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ca3bfd57-ec19-4833-90a1-b0acd96bb182 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:26.731015 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-d7683f40-b33c-4afb-a6a4-d126b2391e27 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:26.750559 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-d7683f40-b33c-4afb-a6a4-d126b2391e27 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1301 microversion: 2.1 time: 1.012781 May 13 14:54:26.756445 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 19/51] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:25 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1301 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:26.774379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b0763314-df02-40b7-8577-e0b6afa2fbf5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:26.778249 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b0763314-df02-40b7-8577-e0b6afa2fbf5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:26.798959 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b0763314-df02-40b7-8577-e0b6afa2fbf5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:26.799433 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b0763314-df02-40b7-8577-e0b6afa2fbf5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:26.802414 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b0763314-df02-40b7-8577-e0b6afa2fbf5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:26.802911 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b0763314-df02-40b7-8577-e0b6afa2fbf5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:26.833000 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ca3bfd57-ec19-4833-90a1-b0acd96bb182 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:26.839924 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ca3bfd57-ec19-4833-90a1-b0acd96bb182 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1221 microversion: 2.1 time: 0.580063 May 13 14:54:26.840493 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 33/52] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:26 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1221 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:26.875838 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-0df41c7d-95eb-4f82-af2e-50f20d28bc42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:26.891002 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-0df41c7d-95eb-4f82-af2e-50f20d28bc42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:26.916327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0df41c7d-95eb-4f82-af2e-50f20d28bc42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:26.917315 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0df41c7d-95eb-4f82-af2e-50f20d28bc42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:26.918138 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0df41c7d-95eb-4f82-af2e-50f20d28bc42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:26.955261 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0df41c7d-95eb-4f82-af2e-50f20d28bc42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:27.833499 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-0df41c7d-95eb-4f82-af2e-50f20d28bc42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:27.846977 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-0df41c7d-95eb-4f82-af2e-50f20d28bc42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:27.867277 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-0df41c7d-95eb-4f82-af2e-50f20d28bc42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:27.869339 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-0df41c7d-95eb-4f82-af2e-50f20d28bc42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1338 microversion: 2.20 time: 1.012836 May 13 14:54:27.882143 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 34/53] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:26 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1338 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:27.895140 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-13107309-1c90-4ba3-ba5e-f4872199b927 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:27.896352 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-13107309-1c90-4ba3-ba5e-f4872199b927 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:27.905823 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-13107309-1c90-4ba3-ba5e-f4872199b927 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:27.906416 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-13107309-1c90-4ba3-ba5e-f4872199b927 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:27.907551 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-13107309-1c90-4ba3-ba5e-f4872199b927 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:27.908135 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-13107309-1c90-4ba3-ba5e-f4872199b927 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:28.296291 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-13107309-1c90-4ba3-ba5e-f4872199b927 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:28.349300 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-13107309-1c90-4ba3-ba5e-f4872199b927 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1296 microversion: 2.1 time: 0.465389 May 13 14:54:28.350931 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 35/54] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:27 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1296 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:28.364677 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-939cef24-31dd-4b72-b784-eab71d4d5808 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:28.365820 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-939cef24-31dd-4b72-b784-eab71d4d5808 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:28.378893 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-939cef24-31dd-4b72-b784-eab71d4d5808 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:28.379772 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-939cef24-31dd-4b72-b784-eab71d4d5808 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:28.380900 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-939cef24-31dd-4b72-b784-eab71d4d5808 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:28.381571 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-939cef24-31dd-4b72-b784-eab71d4d5808 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:28.388241 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b0763314-df02-40b7-8577-e0b6afa2fbf5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:28.407018 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b0763314-df02-40b7-8577-e0b6afa2fbf5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 1.648310 May 13 14:54:28.424685 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 20/55] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:26 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:28.430610 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1543f686-2141-482f-b183-558640012fbd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:28.436982 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1543f686-2141-482f-b183-558640012fbd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:28.468598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1543f686-2141-482f-b183-558640012fbd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:28.469704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1543f686-2141-482f-b183-558640012fbd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:28.471133 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1543f686-2141-482f-b183-558640012fbd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:28.474723 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1543f686-2141-482f-b183-558640012fbd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:28.607656 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-939cef24-31dd-4b72-b784-eab71d4d5808 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:28.630572 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-939cef24-31dd-4b72-b784-eab71d4d5808 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1299 microversion: 2.1 time: 0.277679 May 13 14:54:28.638818 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 36/56] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:28 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1299 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:28.690944 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1543f686-2141-482f-b183-558640012fbd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:28.707216 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1543f686-2141-482f-b183-558640012fbd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1273 microversion: 2.1 time: 0.279927 May 13 14:54:28.709986 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 21/57] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:28 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1273 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:28.896789 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-251523b9-4c7a-4f39-ac22-cd075c8ee457 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:28.897493 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-251523b9-4c7a-4f39-ac22-cd075c8ee457 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:28.913585 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-251523b9-4c7a-4f39-ac22-cd075c8ee457 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:28.914197 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-251523b9-4c7a-4f39-ac22-cd075c8ee457 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:28.916589 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-251523b9-4c7a-4f39-ac22-cd075c8ee457 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:28.921602 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-251523b9-4c7a-4f39-ac22-cd075c8ee457 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:29.368812 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5346c9ec-1377-4ccb-8faa-6084f64b324e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:29.369542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5346c9ec-1377-4ccb-8faa-6084f64b324e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:29.381418 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5346c9ec-1377-4ccb-8faa-6084f64b324e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:29.387973 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5346c9ec-1377-4ccb-8faa-6084f64b324e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:29.407342 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5346c9ec-1377-4ccb-8faa-6084f64b324e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:29.424261 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5346c9ec-1377-4ccb-8faa-6084f64b324e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:30.395107 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-251523b9-4c7a-4f39-ac22-cd075c8ee457 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:30.438524 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-251523b9-4c7a-4f39-ac22-cd075c8ee457 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:30.442726 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-251523b9-4c7a-4f39-ac22-cd075c8ee457 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:30.449722 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-251523b9-4c7a-4f39-ac22-cd075c8ee457 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 1.556987 May 13 14:54:30.459459 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 37/58] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:28 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:30.482990 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-153a6ee9-46ed-4abd-9af8-0ce16358532f tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:30.485095 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-153a6ee9-46ed-4abd-9af8-0ce16358532f tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:30.505509 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-153a6ee9-46ed-4abd-9af8-0ce16358532f tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:30.506393 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-153a6ee9-46ed-4abd-9af8-0ce16358532f tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:30.511742 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-153a6ee9-46ed-4abd-9af8-0ce16358532f tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:30.512512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-153a6ee9-46ed-4abd-9af8-0ce16358532f tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:30.834398 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5346c9ec-1377-4ccb-8faa-6084f64b324e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:30.841835 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5346c9ec-1377-4ccb-8faa-6084f64b324e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 1.478304 May 13 14:54:30.842329 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 22/59] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:29 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:30.865863 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3969c469-1945-404b-b2c5-cdc0c5097403 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:30.867806 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-3969c469-1945-404b-b2c5-cdc0c5097403 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:30.878195 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3969c469-1945-404b-b2c5-cdc0c5097403 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:30.878813 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3969c469-1945-404b-b2c5-cdc0c5097403 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:30.879774 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3969c469-1945-404b-b2c5-cdc0c5097403 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:30.880384 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3969c469-1945-404b-b2c5-cdc0c5097403 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:31.230177 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3969c469-1945-404b-b2c5-cdc0c5097403 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:31.250412 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-3969c469-1945-404b-b2c5-cdc0c5097403 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1299 microversion: 2.1 time: 0.394942 May 13 14:54:31.252085 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 23/60] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:30 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1299 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:31.273376 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8d3b027b-c1db-4657-9e15-c7ee66a21fd6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:31.276501 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8d3b027b-c1db-4657-9e15-c7ee66a21fd6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:31.295324 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8d3b027b-c1db-4657-9e15-c7ee66a21fd6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:31.299408 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8d3b027b-c1db-4657-9e15-c7ee66a21fd6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:31.302428 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8d3b027b-c1db-4657-9e15-c7ee66a21fd6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:31.303349 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8d3b027b-c1db-4657-9e15-c7ee66a21fd6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:31.762241 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8d3b027b-c1db-4657-9e15-c7ee66a21fd6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:31.792252 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8d3b027b-c1db-4657-9e15-c7ee66a21fd6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1279 microversion: 2.1 time: 0.538385 May 13 14:54:31.809882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 24/61] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:31 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1279 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:31.830439 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-4f41926a-2774-4c3d-bac0-006b39068ca4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:31.831042 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-4f41926a-2774-4c3d-bac0-006b39068ca4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:31.863344 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4f41926a-2774-4c3d-bac0-006b39068ca4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:31.864001 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4f41926a-2774-4c3d-bac0-006b39068ca4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:31.864813 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4f41926a-2774-4c3d-bac0-006b39068ca4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:31.865338 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4f41926a-2774-4c3d-bac0-006b39068ca4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:33.394606 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-153a6ee9-46ed-4abd-9af8-0ce16358532f tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:33.422680 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-153a6ee9-46ed-4abd-9af8-0ce16358532f tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 2.957497 May 13 14:54:33.426456 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 38/62] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:30 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 2966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:33.444648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3e0dbed2-1d89-4714-97a1-1c00fbb59456 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:33.450621 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3e0dbed2-1d89-4714-97a1-1c00fbb59456 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:33.457780 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-4f41926a-2774-4c3d-bac0-006b39068ca4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:33.469105 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3e0dbed2-1d89-4714-97a1-1c00fbb59456 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:33.469573 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3e0dbed2-1d89-4714-97a1-1c00fbb59456 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:33.476668 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-4f41926a-2774-4c3d-bac0-006b39068ca4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:33.476848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3e0dbed2-1d89-4714-97a1-1c00fbb59456 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:33.479971 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3e0dbed2-1d89-4714-97a1-1c00fbb59456 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:33.481055 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-4f41926a-2774-4c3d-bac0-006b39068ca4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:33.483299 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-4f41926a-2774-4c3d-bac0-006b39068ca4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 1.671328 May 13 14:54:33.489494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 25/63] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:31 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:33.497099 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e2a4bfb5-e454-4f21-b71b-892c843cbb35 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:33.498552 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-e2a4bfb5-e454-4f21-b71b-892c843cbb35 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:33.509411 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e2a4bfb5-e454-4f21-b71b-892c843cbb35 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:33.510275 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e2a4bfb5-e454-4f21-b71b-892c843cbb35 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:33.512918 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e2a4bfb5-e454-4f21-b71b-892c843cbb35 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:33.514628 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e2a4bfb5-e454-4f21-b71b-892c843cbb35 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:33.841061 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e2a4bfb5-e454-4f21-b71b-892c843cbb35 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:33.865353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e2a4bfb5-e454-4f21-b71b-892c843cbb35 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1299 microversion: 2.1 time: 0.374020 May 13 14:54:33.865969 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 26/64] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:33 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1299 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:33.870638 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-2fd7b951-af16-437a-a94a-4329362b22df tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:33.871169 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-2fd7b951-af16-437a-a94a-4329362b22df tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:33.887600 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2fd7b951-af16-437a-a94a-4329362b22df tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:33.888397 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2fd7b951-af16-437a-a94a-4329362b22df tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:33.889140 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2fd7b951-af16-437a-a94a-4329362b22df tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:33.889575 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2fd7b951-af16-437a-a94a-4329362b22df tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:34.146212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-2fd7b951-af16-437a-a94a-4329362b22df tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:34.164290 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-2fd7b951-af16-437a-a94a-4329362b22df tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1279 microversion: 2.1 time: 0.297222 May 13 14:54:34.175431 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 27/65] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:33 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1279 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:34.180274 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-44965e0c-4ef4-4e04-8f5b-783be077c902 req-cef18b0f-dcfb-4a99-b540-87982d89f16c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96db69fe-6594-486c-96b3-545e6dbfa29b", "tag": "4fd5686b-8efb-4342-9683-06dad26579b5"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:34.214000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-44965e0c-4ef4-4e04-8f5b-783be077c902 req-cef18b0f-dcfb-4a99-b540-87982d89f16c service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:34.214450 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-44965e0c-4ef4-4e04-8f5b-783be077c902 req-cef18b0f-dcfb-4a99-b540-87982d89f16c service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:34.270088 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-44965e0c-4ef4-4e04-8f5b-783be077c902 req-cef18b0f-dcfb-4a99-b540-87982d89f16c service nova] Creating event network-changed:4fd5686b-8efb-4342-9683-06dad26579b5 for instance 96db69fe-6594-486c-96b3-545e6dbfa29b on hv-cinder-83090 May 13 14:54:34.271033 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-44965e0c-4ef4-4e04-8f5b-783be077c902 req-cef18b0f-dcfb-4a99-b540-87982d89f16c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117296) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 13 14:54:34.272330 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1091d489-ef78-413b-b074-09f4dfb9c93b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:34.272928 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1091d489-ef78-413b-b074-09f4dfb9c93b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:34.273920 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1091d489-ef78-413b-b074-09f4dfb9c93b None None] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:34.274514 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1091d489-ef78-413b-b074-09f4dfb9c93b None None] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:34.285339 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.compute.rpcapi [None req-1091d489-ef78-413b-b074-09f4dfb9c93b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 13 14:54:34.286426 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1091d489-ef78-413b-b074-09f4dfb9c93b None None] Releasing lock "compute-rpcapi-router" {{(pid=117296) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 13 14:54:34.315708 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1091d489-ef78-413b-b074-09f4dfb9c93b None None] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138717 May 13 14:54:34.316428 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 28/66] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:34.444390 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f3f2b109-4473-425e-acff-df14359bc515 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:34.445159 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f3f2b109-4473-425e-acff-df14359bc515 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:34.465545 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f3f2b109-4473-425e-acff-df14359bc515 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:34.466447 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f3f2b109-4473-425e-acff-df14359bc515 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:34.467798 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f3f2b109-4473-425e-acff-df14359bc515 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:34.477532 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f3f2b109-4473-425e-acff-df14359bc515 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:34.507408 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3e0dbed2-1d89-4714-97a1-1c00fbb59456 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:34.524371 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3e0dbed2-1d89-4714-97a1-1c00fbb59456 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 1.093697 May 13 14:54:34.528184 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 39/67] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:33 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:34.544100 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-30e303e1-f8d8-4210-b3dd-8e29a8afb6cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:34.544922 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-30e303e1-f8d8-4210-b3dd-8e29a8afb6cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:34.555186 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-30e303e1-f8d8-4210-b3dd-8e29a8afb6cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:34.555639 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-30e303e1-f8d8-4210-b3dd-8e29a8afb6cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:34.556449 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-30e303e1-f8d8-4210-b3dd-8e29a8afb6cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:34.557966 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-30e303e1-f8d8-4210-b3dd-8e29a8afb6cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:35.100049 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f3f2b109-4473-425e-acff-df14359bc515 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:35.112567 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f3f2b109-4473-425e-acff-df14359bc515 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.674411 May 13 14:54:35.113225 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 29/68] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:34 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:35.129639 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-2c12e639-a108-4eba-98a0-48367b20a356 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:35.130259 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-2c12e639-a108-4eba-98a0-48367b20a356 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:35.150903 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2c12e639-a108-4eba-98a0-48367b20a356 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:35.151354 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2c12e639-a108-4eba-98a0-48367b20a356 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:35.152384 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2c12e639-a108-4eba-98a0-48367b20a356 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:35.152615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2c12e639-a108-4eba-98a0-48367b20a356 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:35.227972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-30e303e1-f8d8-4210-b3dd-8e29a8afb6cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:35.239431 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-30e303e1-f8d8-4210-b3dd-8e29a8afb6cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:35.241265 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-30e303e1-f8d8-4210-b3dd-8e29a8afb6cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:35.242760 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-30e303e1-f8d8-4210-b3dd-8e29a8afb6cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.708317 May 13 14:54:35.243469 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 40/69] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:34 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:35.259985 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-de54c3d6-8acd-4fd5-9f98-c3fb6f77d012 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:35.260900 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-de54c3d6-8acd-4fd5-9f98-c3fb6f77d012 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:35.268309 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-de54c3d6-8acd-4fd5-9f98-c3fb6f77d012 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:35.269105 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-de54c3d6-8acd-4fd5-9f98-c3fb6f77d012 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:35.270081 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-de54c3d6-8acd-4fd5-9f98-c3fb6f77d012 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:35.270693 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-de54c3d6-8acd-4fd5-9f98-c3fb6f77d012 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:35.793477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-2c12e639-a108-4eba-98a0-48367b20a356 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:35.802180 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-2c12e639-a108-4eba-98a0-48367b20a356 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.687687 May 13 14:54:35.802783 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 30/70] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:35 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:35.822907 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-bfaa312f-329f-44c2-b381-7741b1d5282e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:35.823723 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-bfaa312f-329f-44c2-b381-7741b1d5282e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:35.836647 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bfaa312f-329f-44c2-b381-7741b1d5282e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:35.837551 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bfaa312f-329f-44c2-b381-7741b1d5282e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:35.838657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bfaa312f-329f-44c2-b381-7741b1d5282e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:35.839256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bfaa312f-329f-44c2-b381-7741b1d5282e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:36.237070 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-de54c3d6-8acd-4fd5-9f98-c3fb6f77d012 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:36.245382 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-de54c3d6-8acd-4fd5-9f98-c3fb6f77d012 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.991731 May 13 14:54:36.245713 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 41/71] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:35 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:36.277675 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-91d14c8a-177d-4444-b8c9-129b09b95b22 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:36.279088 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-91d14c8a-177d-4444-b8c9-129b09b95b22 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:36.288102 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-91d14c8a-177d-4444-b8c9-129b09b95b22 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:36.290495 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-91d14c8a-177d-4444-b8c9-129b09b95b22 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:36.291933 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-91d14c8a-177d-4444-b8c9-129b09b95b22 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:36.293488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-91d14c8a-177d-4444-b8c9-129b09b95b22 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:36.438596 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-bfaa312f-329f-44c2-b381-7741b1d5282e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:36.451112 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-bfaa312f-329f-44c2-b381-7741b1d5282e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.633140 May 13 14:54:36.452164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 31/72] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:35 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:36.464730 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c1726d4d-c1a0-4261-8389-fce689cc693b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:36.465347 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c1726d4d-c1a0-4261-8389-fce689cc693b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:36.475780 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c1726d4d-c1a0-4261-8389-fce689cc693b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:36.477332 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c1726d4d-c1a0-4261-8389-fce689cc693b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:36.478361 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c1726d4d-c1a0-4261-8389-fce689cc693b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:36.482137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c1726d4d-c1a0-4261-8389-fce689cc693b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:36.619173 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-91d14c8a-177d-4444-b8c9-129b09b95b22 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:36.629314 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-91d14c8a-177d-4444-b8c9-129b09b95b22 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.365549 May 13 14:54:36.631034 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 42/73] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:36 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:36.636188 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-35cf5803-0578-4357-aca7-5647ff9b75ef req-b5f177e2-0bdc-4c94-a1a2-b674938ab399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4508cd58-3334-4af7-9c82-1e6e81fd4c4b", "tag": "70ec4a68-e0ec-4b56-ba7a-43cd0cbcb156"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:36.645328 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-35cf5803-0578-4357-aca7-5647ff9b75ef req-b5f177e2-0bdc-4c94-a1a2-b674938ab399 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:36.646077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-35cf5803-0578-4357-aca7-5647ff9b75ef req-b5f177e2-0bdc-4c94-a1a2-b674938ab399 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:36.658496 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-35cf5803-0578-4357-aca7-5647ff9b75ef req-b5f177e2-0bdc-4c94-a1a2-b674938ab399 service nova] Creating event network-changed:70ec4a68-e0ec-4b56-ba7a-43cd0cbcb156 for instance 4508cd58-3334-4af7-9c82-1e6e81fd4c4b on hv-cinder-83090 May 13 14:54:36.665596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-35cf5803-0578-4357-aca7-5647ff9b75ef req-b5f177e2-0bdc-4c94-a1a2-b674938ab399 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032862 May 13 14:54:36.666455 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 43/74] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:36.705774 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c1726d4d-c1a0-4261-8389-fce689cc693b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:36.716114 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c1726d4d-c1a0-4261-8389-fce689cc693b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:36.718307 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c1726d4d-c1a0-4261-8389-fce689cc693b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:36.719560 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c1726d4d-c1a0-4261-8389-fce689cc693b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.266458 May 13 14:54:36.720892 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 32/75] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:36 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:36.819687 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-39c44b95-68c2-47f4-83c1-da827738918c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:36.821504 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-39c44b95-68c2-47f4-83c1-da827738918c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:36.841399 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-39c44b95-68c2-47f4-83c1-da827738918c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:36.843467 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-39c44b95-68c2-47f4-83c1-da827738918c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:36.846246 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-39c44b95-68c2-47f4-83c1-da827738918c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:36.847358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-39c44b95-68c2-47f4-83c1-da827738918c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:36.934426 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-d378858e-cb1b-4eb6-a81f-6fa4f2062a92 req-03228cd7-0b89-46a0-b596-5e9398e3b464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37b68ffc-74f1-4850-ba58-9504e3b5c4c7", "tag": "9586d7b9-e756-4c7c-b9ba-629358746fdc"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:36.961528 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-d378858e-cb1b-4eb6-a81f-6fa4f2062a92 req-03228cd7-0b89-46a0-b596-5e9398e3b464 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:36.962019 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-d378858e-cb1b-4eb6-a81f-6fa4f2062a92 req-03228cd7-0b89-46a0-b596-5e9398e3b464 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:36.979468 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-d378858e-cb1b-4eb6-a81f-6fa4f2062a92 req-03228cd7-0b89-46a0-b596-5e9398e3b464 service nova] Creating event network-changed:9586d7b9-e756-4c7c-b9ba-629358746fdc for instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 on hv-cinder-83090 May 13 14:54:37.000494 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-d378858e-cb1b-4eb6-a81f-6fa4f2062a92 req-03228cd7-0b89-46a0-b596-5e9398e3b464 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.328043 May 13 14:54:37.003759 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 44/76] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:37.153598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-39c44b95-68c2-47f4-83c1-da827738918c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:37.163921 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-39c44b95-68c2-47f4-83c1-da827738918c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.348882 May 13 14:54:37.174887 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 33/77] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:36 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:37.263284 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-bacf2029-5fe3-4bc8-95d0-8686c6f7e96f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:37.264011 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-bacf2029-5fe3-4bc8-95d0-8686c6f7e96f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:37.272949 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bacf2029-5fe3-4bc8-95d0-8686c6f7e96f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:37.273399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bacf2029-5fe3-4bc8-95d0-8686c6f7e96f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:37.274177 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bacf2029-5fe3-4bc8-95d0-8686c6f7e96f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:37.274607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bacf2029-5fe3-4bc8-95d0-8686c6f7e96f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:37.440061 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-bacf2029-5fe3-4bc8-95d0-8686c6f7e96f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:37.447749 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-bacf2029-5fe3-4bc8-95d0-8686c6f7e96f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.188774 May 13 14:54:37.448542 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 45/78] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:37 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:37.468567 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-81985827-dabc-4b57-974d-a966696e7e89 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:37.469173 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-81985827-dabc-4b57-974d-a966696e7e89 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:37.480264 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-81985827-dabc-4b57-974d-a966696e7e89 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:37.480625 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-81985827-dabc-4b57-974d-a966696e7e89 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:37.481392 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-81985827-dabc-4b57-974d-a966696e7e89 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:37.482060 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-81985827-dabc-4b57-974d-a966696e7e89 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:37.622061 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-81985827-dabc-4b57-974d-a966696e7e89 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:37.629598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-81985827-dabc-4b57-974d-a966696e7e89 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.165151 May 13 14:54:37.630166 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 34/79] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:37 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:37.647040 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-218489b2-7d72-4a83-b781-f05738cd6e40 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:37.647599 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-218489b2-7d72-4a83-b781-f05738cd6e40 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:37.654098 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-218489b2-7d72-4a83-b781-f05738cd6e40 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:37.654534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-218489b2-7d72-4a83-b781-f05738cd6e40 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:37.655312 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-218489b2-7d72-4a83-b781-f05738cd6e40 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:37.655919 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-218489b2-7d72-4a83-b781-f05738cd6e40 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:37.740216 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-06399cd0-8c45-4d1d-8887-7701a22e87ca tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:37.741248 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-06399cd0-8c45-4d1d-8887-7701a22e87ca tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:37.747891 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-06399cd0-8c45-4d1d-8887-7701a22e87ca tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:37.748640 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-06399cd0-8c45-4d1d-8887-7701a22e87ca tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:37.750634 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-06399cd0-8c45-4d1d-8887-7701a22e87ca tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:37.751511 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-06399cd0-8c45-4d1d-8887-7701a22e87ca tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:37.877519 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-218489b2-7d72-4a83-b781-f05738cd6e40 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:37.887154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-218489b2-7d72-4a83-b781-f05738cd6e40 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.244067 May 13 14:54:37.889656 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 46/80] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:37 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:38.155514 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-06399cd0-8c45-4d1d-8887-7701a22e87ca tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:38.170359 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-06399cd0-8c45-4d1d-8887-7701a22e87ca tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:38.174369 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-06399cd0-8c45-4d1d-8887-7701a22e87ca tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:38.179772 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-06399cd0-8c45-4d1d-8887-7701a22e87ca tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.443283 May 13 14:54:38.182624 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-b0919634-73a6-4c13-9059-870d127ed2e4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:38.183259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-b0919634-73a6-4c13-9059-870d127ed2e4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:38.191525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 35/81] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:37 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:54:38.195566 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b0919634-73a6-4c13-9059-870d127ed2e4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:38.198728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b0919634-73a6-4c13-9059-870d127ed2e4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:38.199744 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b0919634-73a6-4c13-9059-870d127ed2e4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:38.200589 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b0919634-73a6-4c13-9059-870d127ed2e4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:38.465715 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ccdc0905-84a5-4c3e-b4bb-4cd4ef63245d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:38.466932 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ccdc0905-84a5-4c3e-b4bb-4cd4ef63245d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:38.476421 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ccdc0905-84a5-4c3e-b4bb-4cd4ef63245d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:38.476875 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ccdc0905-84a5-4c3e-b4bb-4cd4ef63245d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:38.478034 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ccdc0905-84a5-4c3e-b4bb-4cd4ef63245d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:38.478488 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ccdc0905-84a5-4c3e-b4bb-4cd4ef63245d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:39.312612 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b0919634-73a6-4c13-9059-870d127ed2e4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:39.320247 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-b0919634-73a6-4c13-9059-870d127ed2e4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 1.142773 May 13 14:54:39.320814 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 47/82] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:38 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:39.326961 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f2191bc3-11c2-416d-bb85-45d77e2beed5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:39.327574 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f2191bc3-11c2-416d-bb85-45d77e2beed5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:39.333818 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f2191bc3-11c2-416d-bb85-45d77e2beed5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:39.334266 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f2191bc3-11c2-416d-bb85-45d77e2beed5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:39.335209 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f2191bc3-11c2-416d-bb85-45d77e2beed5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:39.335809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f2191bc3-11c2-416d-bb85-45d77e2beed5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:39.375963 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ccdc0905-84a5-4c3e-b4bb-4cd4ef63245d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:39.384223 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ccdc0905-84a5-4c3e-b4bb-4cd4ef63245d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.923574 May 13 14:54:39.384814 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 36/83] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:38 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:39.391782 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8fccb136-666b-41a8-85dc-42abb4d1a7fd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:39.392544 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8fccb136-666b-41a8-85dc-42abb4d1a7fd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:39.399387 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8fccb136-666b-41a8-85dc-42abb4d1a7fd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:39.400019 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8fccb136-666b-41a8-85dc-42abb4d1a7fd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:39.400811 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8fccb136-666b-41a8-85dc-42abb4d1a7fd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:39.401253 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8fccb136-666b-41a8-85dc-42abb4d1a7fd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:39.609249 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f2191bc3-11c2-416d-bb85-45d77e2beed5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:39.616530 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f2191bc3-11c2-416d-bb85-45d77e2beed5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.294488 May 13 14:54:39.626097 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 48/84] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:39 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:39.631145 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-31fd5a25-4fbb-414f-89b5-8327cc1d131b req-6b1d6c88-d508-4890-9330-7c01cb2be6a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "137f45b0-0ba4-4c2e-8588-b45112a1c7d7", "tag": "ee93aa72-1b63-48c8-bbd1-9a3c75bec1fe"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:39.639636 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-31fd5a25-4fbb-414f-89b5-8327cc1d131b req-6b1d6c88-d508-4890-9330-7c01cb2be6a8 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:39.640132 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-31fd5a25-4fbb-414f-89b5-8327cc1d131b req-6b1d6c88-d508-4890-9330-7c01cb2be6a8 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:39.653671 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-31fd5a25-4fbb-414f-89b5-8327cc1d131b req-6b1d6c88-d508-4890-9330-7c01cb2be6a8 service nova] Creating event network-changed:ee93aa72-1b63-48c8-bbd1-9a3c75bec1fe for instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 on hv-cinder-83090 May 13 14:54:39.660938 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-31fd5a25-4fbb-414f-89b5-8327cc1d131b req-6b1d6c88-d508-4890-9330-7c01cb2be6a8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033359 May 13 14:54:39.662434 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 49/85] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:39.670212 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4af00864-ec1e-4690-aab0-245b688b2f3e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:39.670991 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4af00864-ec1e-4690-aab0-245b688b2f3e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:39.677854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8fccb136-666b-41a8-85dc-42abb4d1a7fd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:39.684260 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4af00864-ec1e-4690-aab0-245b688b2f3e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:39.685714 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4af00864-ec1e-4690-aab0-245b688b2f3e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:39.687278 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4af00864-ec1e-4690-aab0-245b688b2f3e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:39.687414 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8fccb136-666b-41a8-85dc-42abb4d1a7fd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.301174 May 13 14:54:39.687900 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4af00864-ec1e-4690-aab0-245b688b2f3e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:39.688714 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 37/86] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:39 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:39.908386 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4af00864-ec1e-4690-aab0-245b688b2f3e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:39.918465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4af00864-ec1e-4690-aab0-245b688b2f3e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:39.920207 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4af00864-ec1e-4690-aab0-245b688b2f3e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:39.926182 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4af00864-ec1e-4690-aab0-245b688b2f3e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.257611 May 13 14:54:39.929660 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 50/87] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:39 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:40.336838 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-24341cd1-b2c3-42f3-bb0f-734443a733a7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:40.337469 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-24341cd1-b2c3-42f3-bb0f-734443a733a7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:40.344220 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24341cd1-b2c3-42f3-bb0f-734443a733a7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:40.344671 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24341cd1-b2c3-42f3-bb0f-734443a733a7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:40.345480 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24341cd1-b2c3-42f3-bb0f-734443a733a7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:40.345932 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24341cd1-b2c3-42f3-bb0f-734443a733a7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:40.402443 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-848c666d-1187-4d0a-87ea-2cf955eb3f08 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:40.403033 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-848c666d-1187-4d0a-87ea-2cf955eb3f08 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:40.409687 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-848c666d-1187-4d0a-87ea-2cf955eb3f08 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:40.410391 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-848c666d-1187-4d0a-87ea-2cf955eb3f08 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:40.411524 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-848c666d-1187-4d0a-87ea-2cf955eb3f08 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:40.412155 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-848c666d-1187-4d0a-87ea-2cf955eb3f08 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:40.539055 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-24341cd1-b2c3-42f3-bb0f-734443a733a7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:40.547312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-24341cd1-b2c3-42f3-bb0f-734443a733a7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.214345 May 13 14:54:40.547888 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 38/88] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:40 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:40.577284 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-848c666d-1187-4d0a-87ea-2cf955eb3f08 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:40.585394 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-848c666d-1187-4d0a-87ea-2cf955eb3f08 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.186956 May 13 14:54:40.585994 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 51/89] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:40 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:40.633362 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-12c76b3a-8129-4fc6-9606-9792a67a8f2f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:40.634088 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-12c76b3a-8129-4fc6-9606-9792a67a8f2f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:40.641314 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-12c76b3a-8129-4fc6-9606-9792a67a8f2f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:40.641783 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-12c76b3a-8129-4fc6-9606-9792a67a8f2f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:40.642592 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-12c76b3a-8129-4fc6-9606-9792a67a8f2f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:40.642957 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-12c76b3a-8129-4fc6-9606-9792a67a8f2f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:40.705461 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-112ce19f-d5a9-482e-9266-a9cd791d5949 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:40.706490 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-112ce19f-d5a9-482e-9266-a9cd791d5949 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:40.712966 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-112ce19f-d5a9-482e-9266-a9cd791d5949 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:40.713474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-112ce19f-d5a9-482e-9266-a9cd791d5949 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:40.714302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-112ce19f-d5a9-482e-9266-a9cd791d5949 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:40.714696 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-112ce19f-d5a9-482e-9266-a9cd791d5949 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:40.865727 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-12c76b3a-8129-4fc6-9606-9792a67a8f2f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:40.873949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-12c76b3a-8129-4fc6-9606-9792a67a8f2f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.244481 May 13 14:54:40.874520 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 39/90] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:40 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:40.902933 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-112ce19f-d5a9-482e-9266-a9cd791d5949 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:40.910647 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-112ce19f-d5a9-482e-9266-a9cd791d5949 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.209815 May 13 14:54:40.911446 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 52/91] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:40 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:40.945969 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-71506417-0753-4ffa-9765-4a780db96cc8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:40.946675 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-71506417-0753-4ffa-9765-4a780db96cc8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:40.953586 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-71506417-0753-4ffa-9765-4a780db96cc8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:40.954022 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-71506417-0753-4ffa-9765-4a780db96cc8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:40.954976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-71506417-0753-4ffa-9765-4a780db96cc8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:40.955400 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-71506417-0753-4ffa-9765-4a780db96cc8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:41.091769 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-71506417-0753-4ffa-9765-4a780db96cc8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:41.100609 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-71506417-0753-4ffa-9765-4a780db96cc8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:41.102100 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-71506417-0753-4ffa-9765-4a780db96cc8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:41.103205 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-71506417-0753-4ffa-9765-4a780db96cc8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.161404 May 13 14:54:41.103798 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 40/92] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:40 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:41.569490 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-70de0879-69c3-4b5e-900e-5b57824341d8 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:41.570145 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-70de0879-69c3-4b5e-900e-5b57824341d8 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:41.579005 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-70de0879-69c3-4b5e-900e-5b57824341d8 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:41.579659 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-70de0879-69c3-4b5e-900e-5b57824341d8 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:41.580750 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-70de0879-69c3-4b5e-900e-5b57824341d8 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:41.581370 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-70de0879-69c3-4b5e-900e-5b57824341d8 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:41.602467 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-331ec341-f0db-4dba-85f5-44ae61d6e086 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:41.603078 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-331ec341-f0db-4dba-85f5-44ae61d6e086 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:41.615606 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-331ec341-f0db-4dba-85f5-44ae61d6e086 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:41.616354 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-331ec341-f0db-4dba-85f5-44ae61d6e086 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:41.619007 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-331ec341-f0db-4dba-85f5-44ae61d6e086 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:41.621577 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-331ec341-f0db-4dba-85f5-44ae61d6e086 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:42.348457 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-70de0879-69c3-4b5e-900e-5b57824341d8 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:42.359136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-70de0879-69c3-4b5e-900e-5b57824341d8 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.795329 May 13 14:54:42.360052 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 53/93] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:41 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:42.366386 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-fd692ddd-8cad-43b9-8fa2-a96e52b01b85 req-8f2a7285-a188-436a-819a-f8837f614f7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58eef483-5204-4068-bb39-476a857f0af1", "tag": "23f1961d-71e7-41fe-a16b-42eb34061faf"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:42.379211 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-fd692ddd-8cad-43b9-8fa2-a96e52b01b85 req-8f2a7285-a188-436a-819a-f8837f614f7f service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:42.379787 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-fd692ddd-8cad-43b9-8fa2-a96e52b01b85 req-8f2a7285-a188-436a-819a-f8837f614f7f service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:42.397391 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-fd692ddd-8cad-43b9-8fa2-a96e52b01b85 req-8f2a7285-a188-436a-819a-f8837f614f7f service nova] Creating event network-changed:23f1961d-71e7-41fe-a16b-42eb34061faf for instance 58eef483-5204-4068-bb39-476a857f0af1 on hv-cinder-83090 May 13 14:54:42.401954 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-331ec341-f0db-4dba-85f5-44ae61d6e086 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:42.413728 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-331ec341-f0db-4dba-85f5-44ae61d6e086 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.815797 May 13 14:54:42.415493 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 41/94] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:41 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:42.417257 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-fd692ddd-8cad-43b9-8fa2-a96e52b01b85 req-8f2a7285-a188-436a-819a-f8837f614f7f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056036 May 13 14:54:42.420459 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 54/95] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:42.432784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f0ed97fe-bb27-4426-8d12-a856c5106f3d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:42.433518 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f0ed97fe-bb27-4426-8d12-a856c5106f3d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:42.444012 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f0ed97fe-bb27-4426-8d12-a856c5106f3d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:42.444615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f0ed97fe-bb27-4426-8d12-a856c5106f3d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:42.445385 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f68b78e2-5c8c-4a3e-8d7c-bb7a7fb512ed tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:42.446095 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f68b78e2-5c8c-4a3e-8d7c-bb7a7fb512ed tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:42.446214 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f0ed97fe-bb27-4426-8d12-a856c5106f3d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:42.446544 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f0ed97fe-bb27-4426-8d12-a856c5106f3d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:42.456562 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f68b78e2-5c8c-4a3e-8d7c-bb7a7fb512ed tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:42.457283 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f68b78e2-5c8c-4a3e-8d7c-bb7a7fb512ed tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:42.458285 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f68b78e2-5c8c-4a3e-8d7c-bb7a7fb512ed tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:42.459024 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f68b78e2-5c8c-4a3e-8d7c-bb7a7fb512ed tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:42.691832 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f0ed97fe-bb27-4426-8d12-a856c5106f3d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:42.699434 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f0ed97fe-bb27-4426-8d12-a856c5106f3d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.280936 May 13 14:54:42.709941 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 42/96] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:42 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:42.714294 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f68b78e2-5c8c-4a3e-8d7c-bb7a7fb512ed tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:42.715580 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-57071799-338a-4df3-aa52-3faf880e5ac1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:42.716385 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-57071799-338a-4df3-aa52-3faf880e5ac1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:42.724642 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f68b78e2-5c8c-4a3e-8d7c-bb7a7fb512ed tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.294688 May 13 14:54:42.725423 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 55/97] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:42 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:42.725948 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-57071799-338a-4df3-aa52-3faf880e5ac1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:42.726499 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-57071799-338a-4df3-aa52-3faf880e5ac1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:42.727303 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-57071799-338a-4df3-aa52-3faf880e5ac1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:42.728263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-57071799-338a-4df3-aa52-3faf880e5ac1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:42.872352 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-57071799-338a-4df3-aa52-3faf880e5ac1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:42.879366 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-ecef8d75-ec9b-4e6a-8b27-c79a806fe43f req-076f852d-b220-4c28-a4b6-b78fc7e39c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1542a35b-8d51-4329-89e1-e68453edcb61", "name": "network-vif-plugged", "status": "completed", "tag": "b9563ab0-d4b8-426f-af56-b221edbff1ee"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:42.883590 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-57071799-338a-4df3-aa52-3faf880e5ac1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:42.886151 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-57071799-338a-4df3-aa52-3faf880e5ac1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:42.888358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-57071799-338a-4df3-aa52-3faf880e5ac1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.176582 May 13 14:54:42.888695 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-ecef8d75-ec9b-4e6a-8b27-c79a806fe43f req-076f852d-b220-4c28-a4b6-b78fc7e39c2e service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:42.889139 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-ecef8d75-ec9b-4e6a-8b27-c79a806fe43f req-076f852d-b220-4c28-a4b6-b78fc7e39c2e service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:42.890006 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 43/98] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:42 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:42.902214 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-ecef8d75-ec9b-4e6a-8b27-c79a806fe43f req-076f852d-b220-4c28-a4b6-b78fc7e39c2e service nova] Creating event network-vif-plugged:b9563ab0-d4b8-426f-af56-b221edbff1ee for instance 1542a35b-8d51-4329-89e1-e68453edcb61 on hv-cinder-83090 May 13 14:54:42.907756 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-ecef8d75-ec9b-4e6a-8b27-c79a806fe43f req-076f852d-b220-4c28-a4b6-b78fc7e39c2e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180702 May 13 14:54:42.908463 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 56/99] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:43.376970 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-bfcb3d6f-ff54-47ab-8706-e3057c60760d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:43.377867 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-bfcb3d6f-ff54-47ab-8706-e3057c60760d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:43.384114 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bfcb3d6f-ff54-47ab-8706-e3057c60760d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:43.384560 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bfcb3d6f-ff54-47ab-8706-e3057c60760d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:43.385332 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bfcb3d6f-ff54-47ab-8706-e3057c60760d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:43.385764 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bfcb3d6f-ff54-47ab-8706-e3057c60760d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:43.430670 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-75cdb1ca-0b3d-48df-b469-fa52ae5253ba tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:43.431387 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-75cdb1ca-0b3d-48df-b469-fa52ae5253ba tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:43.453844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-75cdb1ca-0b3d-48df-b469-fa52ae5253ba tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:43.454292 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-75cdb1ca-0b3d-48df-b469-fa52ae5253ba tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:43.456051 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-75cdb1ca-0b3d-48df-b469-fa52ae5253ba tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:43.456494 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-75cdb1ca-0b3d-48df-b469-fa52ae5253ba tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:43.614824 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-bfcb3d6f-ff54-47ab-8706-e3057c60760d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:43.623812 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-bfcb3d6f-ff54-47ab-8706-e3057c60760d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.250541 May 13 14:54:43.624999 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 44/100] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:43 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:43.651692 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-75cdb1ca-0b3d-48df-b469-fa52ae5253ba tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:43.660121 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-75cdb1ca-0b3d-48df-b469-fa52ae5253ba tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.233674 May 13 14:54:43.660702 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 57/101] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:43 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:43.717068 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6648ebac-5653-4896-8c4a-6b28179241dc tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:43.718279 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6648ebac-5653-4896-8c4a-6b28179241dc tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:43.728184 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6648ebac-5653-4896-8c4a-6b28179241dc tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:43.728184 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6648ebac-5653-4896-8c4a-6b28179241dc tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:43.728935 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6648ebac-5653-4896-8c4a-6b28179241dc tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:43.729616 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6648ebac-5653-4896-8c4a-6b28179241dc tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:43.743511 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-183e19e2-10c6-412a-86be-2b9a57bcdf93 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:43.744687 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-183e19e2-10c6-412a-86be-2b9a57bcdf93 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:43.753432 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-183e19e2-10c6-412a-86be-2b9a57bcdf93 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:43.754959 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-183e19e2-10c6-412a-86be-2b9a57bcdf93 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:43.755898 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-183e19e2-10c6-412a-86be-2b9a57bcdf93 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:43.757250 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-183e19e2-10c6-412a-86be-2b9a57bcdf93 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:43.922238 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6648ebac-5653-4896-8c4a-6b28179241dc tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:43.929995 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6648ebac-5653-4896-8c4a-6b28179241dc tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.216779 May 13 14:54:43.930577 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 45/102] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:43 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:43.935055 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1b51e55b-c6f2-4818-a850-49f07613fd5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:43.935643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1b51e55b-c6f2-4818-a850-49f07613fd5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:43.945894 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1b51e55b-c6f2-4818-a850-49f07613fd5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:43.946508 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1b51e55b-c6f2-4818-a850-49f07613fd5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:43.947408 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1b51e55b-c6f2-4818-a850-49f07613fd5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:43.948155 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1b51e55b-c6f2-4818-a850-49f07613fd5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:43.969898 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-183e19e2-10c6-412a-86be-2b9a57bcdf93 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:43.980774 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-183e19e2-10c6-412a-86be-2b9a57bcdf93 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.242035 May 13 14:54:43.981358 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 58/103] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:43 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:44.110778 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1b51e55b-c6f2-4818-a850-49f07613fd5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:44.120135 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1b51e55b-c6f2-4818-a850-49f07613fd5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:44.120339 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1b51e55b-c6f2-4818-a850-49f07613fd5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:44.121437 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1b51e55b-c6f2-4818-a850-49f07613fd5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.189967 May 13 14:54:44.121982 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 46/104] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:43 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:44.649269 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-fa1d6d0f-9756-4aef-a178-335c6b516de0 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:44.649840 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-fa1d6d0f-9756-4aef-a178-335c6b516de0 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:44.656249 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fa1d6d0f-9756-4aef-a178-335c6b516de0 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:44.656941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fa1d6d0f-9756-4aef-a178-335c6b516de0 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:44.657869 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fa1d6d0f-9756-4aef-a178-335c6b516de0 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:44.658477 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fa1d6d0f-9756-4aef-a178-335c6b516de0 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:44.676899 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f285b913-d2eb-4d9c-aeff-673aee816dc6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:44.677497 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f285b913-d2eb-4d9c-aeff-673aee816dc6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:44.683463 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f285b913-d2eb-4d9c-aeff-673aee816dc6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:44.683931 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f285b913-d2eb-4d9c-aeff-673aee816dc6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:44.685075 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f285b913-d2eb-4d9c-aeff-673aee816dc6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:44.685652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f285b913-d2eb-4d9c-aeff-673aee816dc6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:45.117266 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-fa1d6d0f-9756-4aef-a178-335c6b516de0 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:45.126319 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-fa1d6d0f-9756-4aef-a178-335c6b516de0 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.489500 May 13 14:54:45.126935 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 59/105] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:44 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:45.131959 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-80c1d296-92fb-4442-a006-55337b0ca5d8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:45.132746 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-80c1d296-92fb-4442-a006-55337b0ca5d8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:45.139638 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-80c1d296-92fb-4442-a006-55337b0ca5d8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:45.140133 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-80c1d296-92fb-4442-a006-55337b0ca5d8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:45.141240 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-80c1d296-92fb-4442-a006-55337b0ca5d8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:45.141698 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-80c1d296-92fb-4442-a006-55337b0ca5d8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:45.152852 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f285b913-d2eb-4d9c-aeff-673aee816dc6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:45.165677 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f285b913-d2eb-4d9c-aeff-673aee816dc6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.492356 May 13 14:54:45.167628 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 47/106] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:44 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:45.174253 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-0d2cfe19-1cc4-4a3d-9bcf-6db58a636050 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:45.176350 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-0d2cfe19-1cc4-4a3d-9bcf-6db58a636050 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:45.182549 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0d2cfe19-1cc4-4a3d-9bcf-6db58a636050 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:45.183073 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0d2cfe19-1cc4-4a3d-9bcf-6db58a636050 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:45.184144 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0d2cfe19-1cc4-4a3d-9bcf-6db58a636050 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:45.184637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0d2cfe19-1cc4-4a3d-9bcf-6db58a636050 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:45.360995 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-80c1d296-92fb-4442-a006-55337b0ca5d8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:45.373774 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-80c1d296-92fb-4442-a006-55337b0ca5d8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.245592 May 13 14:54:45.383024 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 60/107] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:45 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:45.383024 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4b670a53-86ff-4ec1-b171-983a23977260 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:45.383024 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4b670a53-86ff-4ec1-b171-983a23977260 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:45.388708 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-0d2cfe19-1cc4-4a3d-9bcf-6db58a636050 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:45.391806 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4b670a53-86ff-4ec1-b171-983a23977260 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:45.392290 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4b670a53-86ff-4ec1-b171-983a23977260 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:45.393765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4b670a53-86ff-4ec1-b171-983a23977260 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:45.394211 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4b670a53-86ff-4ec1-b171-983a23977260 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:45.397409 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-0d2cfe19-1cc4-4a3d-9bcf-6db58a636050 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.227252 May 13 14:54:45.398977 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 48/108] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:45 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:45.562320 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4b670a53-86ff-4ec1-b171-983a23977260 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:45.577285 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4b670a53-86ff-4ec1-b171-983a23977260 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:45.578930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4b670a53-86ff-4ec1-b171-983a23977260 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:45.580144 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4b670a53-86ff-4ec1-b171-983a23977260 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.204398 May 13 14:54:45.581626 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 61/109] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:45 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:46.144412 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cee4867a-1cd4-4058-855d-bce2b9554c0f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:46.145121 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-cee4867a-1cd4-4058-855d-bce2b9554c0f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:46.152226 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cee4867a-1cd4-4058-855d-bce2b9554c0f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:46.152796 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cee4867a-1cd4-4058-855d-bce2b9554c0f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:46.153616 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cee4867a-1cd4-4058-855d-bce2b9554c0f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:46.154305 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cee4867a-1cd4-4058-855d-bce2b9554c0f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:46.183928 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-6a6f69cf-f5b0-484e-a4a5-3ff02bd4028b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:46.184670 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-6a6f69cf-f5b0-484e-a4a5-3ff02bd4028b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:46.191257 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6a6f69cf-f5b0-484e-a4a5-3ff02bd4028b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:46.191776 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6a6f69cf-f5b0-484e-a4a5-3ff02bd4028b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:46.192608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6a6f69cf-f5b0-484e-a4a5-3ff02bd4028b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:46.193039 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6a6f69cf-f5b0-484e-a4a5-3ff02bd4028b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:46.494665 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-cee4867a-1cd4-4058-855d-bce2b9554c0f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:46.516963 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-cee4867a-1cd4-4058-855d-bce2b9554c0f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.375859 May 13 14:54:46.519072 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-6a6f69cf-f5b0-484e-a4a5-3ff02bd4028b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:46.520236 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 49/110] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:46 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:46.527412 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e677af4d-b002-4fc9-aafb-5e2eaef17f32 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:46.528189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-e677af4d-b002-4fc9-aafb-5e2eaef17f32 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:46.536001 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e677af4d-b002-4fc9-aafb-5e2eaef17f32 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:46.536657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e677af4d-b002-4fc9-aafb-5e2eaef17f32 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:46.537519 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-6a6f69cf-f5b0-484e-a4a5-3ff02bd4028b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.357878 May 13 14:54:46.537953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e677af4d-b002-4fc9-aafb-5e2eaef17f32 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:46.538153 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 62/111] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:46 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:46.538914 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e677af4d-b002-4fc9-aafb-5e2eaef17f32 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:46.558674 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-17fa2ee4-eb8a-4414-a5ca-23beaa85b4c2 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:46.559327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-17fa2ee4-eb8a-4414-a5ca-23beaa85b4c2 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:46.566748 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-17fa2ee4-eb8a-4414-a5ca-23beaa85b4c2 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:46.567194 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-17fa2ee4-eb8a-4414-a5ca-23beaa85b4c2 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:46.568079 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-17fa2ee4-eb8a-4414-a5ca-23beaa85b4c2 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:46.568514 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-17fa2ee4-eb8a-4414-a5ca-23beaa85b4c2 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:46.757647 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e677af4d-b002-4fc9-aafb-5e2eaef17f32 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:46.768295 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e677af4d-b002-4fc9-aafb-5e2eaef17f32 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.244731 May 13 14:54:46.784703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 50/112] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:46 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:46.801091 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-17fa2ee4-eb8a-4414-a5ca-23beaa85b4c2 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:46.804712 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5cae75a6-ff9e-4422-b762-aa181189c11a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:46.805323 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5cae75a6-ff9e-4422-b762-aa181189c11a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:46.815061 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-17fa2ee4-eb8a-4414-a5ca-23beaa85b4c2 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.275572 May 13 14:54:46.815996 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 63/113] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:46 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:46.831684 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5cae75a6-ff9e-4422-b762-aa181189c11a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:46.832145 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5cae75a6-ff9e-4422-b762-aa181189c11a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:46.834872 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5cae75a6-ff9e-4422-b762-aa181189c11a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:46.835317 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5cae75a6-ff9e-4422-b762-aa181189c11a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:47.026183 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5cae75a6-ff9e-4422-b762-aa181189c11a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:47.035183 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5cae75a6-ff9e-4422-b762-aa181189c11a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:47.037256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5cae75a6-ff9e-4422-b762-aa181189c11a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:47.038712 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5cae75a6-ff9e-4422-b762-aa181189c11a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.252756 May 13 14:54:47.039437 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 51/114] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:46 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:47.536629 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f5979acc-67c0-455f-b426-48eb898115d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:47.537238 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f5979acc-67c0-455f-b426-48eb898115d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:47.542995 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f5979acc-67c0-455f-b426-48eb898115d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:47.543432 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f5979acc-67c0-455f-b426-48eb898115d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:47.544259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f5979acc-67c0-455f-b426-48eb898115d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:47.544744 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f5979acc-67c0-455f-b426-48eb898115d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:47.554418 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b47ebc29-48f4-4b45-9a72-a0be8a6918c3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:47.555009 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b47ebc29-48f4-4b45-9a72-a0be8a6918c3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:47.561948 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b47ebc29-48f4-4b45-9a72-a0be8a6918c3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:47.562409 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b47ebc29-48f4-4b45-9a72-a0be8a6918c3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:47.563335 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b47ebc29-48f4-4b45-9a72-a0be8a6918c3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:47.563773 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b47ebc29-48f4-4b45-9a72-a0be8a6918c3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:47.753979 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f5979acc-67c0-455f-b426-48eb898115d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:47.761565 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f5979acc-67c0-455f-b426-48eb898115d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.228700 May 13 14:54:47.771434 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b47ebc29-48f4-4b45-9a72-a0be8a6918c3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:47.772029 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 64/115] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:47 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:47.773865 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b47ebc29-48f4-4b45-9a72-a0be8a6918c3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.223236 May 13 14:54:47.774432 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 52/116] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:47 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:47.787178 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4adc0e44-1a63-4c59-90cc-9cede5f0fc26 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:47.787833 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4adc0e44-1a63-4c59-90cc-9cede5f0fc26 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:47.794036 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4adc0e44-1a63-4c59-90cc-9cede5f0fc26 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:47.795415 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4adc0e44-1a63-4c59-90cc-9cede5f0fc26 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:47.795627 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4adc0e44-1a63-4c59-90cc-9cede5f0fc26 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:47.795997 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4adc0e44-1a63-4c59-90cc-9cede5f0fc26 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:47.832907 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9de6ca4a-bb4b-43a1-a527-cffe608f6f98 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:47.833523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-9de6ca4a-bb4b-43a1-a527-cffe608f6f98 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:47.839672 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9de6ca4a-bb4b-43a1-a527-cffe608f6f98 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:47.840068 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9de6ca4a-bb4b-43a1-a527-cffe608f6f98 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:47.841030 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9de6ca4a-bb4b-43a1-a527-cffe608f6f98 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:47.841793 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9de6ca4a-bb4b-43a1-a527-cffe608f6f98 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:47.980727 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4adc0e44-1a63-4c59-90cc-9cede5f0fc26 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:47.989502 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4adc0e44-1a63-4c59-90cc-9cede5f0fc26 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.207313 May 13 14:54:47.990603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 65/117] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:47 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:48.019932 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9de6ca4a-bb4b-43a1-a527-cffe608f6f98 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:48.027822 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9de6ca4a-bb4b-43a1-a527-cffe608f6f98 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.198886 May 13 14:54:48.028643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 53/118] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:47 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:48.057590 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-b0bd2d5d-ba9d-4602-8576-c5037d7b2095 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:48.058509 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-b0bd2d5d-ba9d-4602-8576-c5037d7b2095 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:48.064810 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b0bd2d5d-ba9d-4602-8576-c5037d7b2095 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:48.065256 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b0bd2d5d-ba9d-4602-8576-c5037d7b2095 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:48.066029 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b0bd2d5d-ba9d-4602-8576-c5037d7b2095 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:48.066605 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b0bd2d5d-ba9d-4602-8576-c5037d7b2095 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:48.207665 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b0bd2d5d-ba9d-4602-8576-c5037d7b2095 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:48.219445 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b0bd2d5d-ba9d-4602-8576-c5037d7b2095 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:48.220952 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b0bd2d5d-ba9d-4602-8576-c5037d7b2095 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:48.222222 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-b0bd2d5d-ba9d-4602-8576-c5037d7b2095 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.168492 May 13 14:54:48.222950 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 66/119] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:48 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:48.366735 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-9b5784a3-f70b-46b0-9914-2a265222d5af req-db9dbf4b-b74d-45b9-ab85-beed91438f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4508cd58-3334-4af7-9c82-1e6e81fd4c4b", "name": "network-vif-plugged", "status": "completed", "tag": "70ec4a68-e0ec-4b56-ba7a-43cd0cbcb156"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:48.375392 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-9b5784a3-f70b-46b0-9914-2a265222d5af req-db9dbf4b-b74d-45b9-ab85-beed91438f73 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:48.375828 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-9b5784a3-f70b-46b0-9914-2a265222d5af req-db9dbf4b-b74d-45b9-ab85-beed91438f73 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:48.387851 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-9b5784a3-f70b-46b0-9914-2a265222d5af req-db9dbf4b-b74d-45b9-ab85-beed91438f73 service nova] Creating event network-vif-plugged:70ec4a68-e0ec-4b56-ba7a-43cd0cbcb156 for instance 4508cd58-3334-4af7-9c82-1e6e81fd4c4b on hv-cinder-83090 May 13 14:54:48.393660 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-9b5784a3-f70b-46b0-9914-2a265222d5af req-db9dbf4b-b74d-45b9-ab85-beed91438f73 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030802 May 13 14:54:48.394590 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 54/120] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:54:48.778508 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-21f0d135-a577-45e1-9ee3-9cdcffacac63 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:48.779174 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-21f0d135-a577-45e1-9ee3-9cdcffacac63 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:48.785751 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-21f0d135-a577-45e1-9ee3-9cdcffacac63 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:48.786302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-21f0d135-a577-45e1-9ee3-9cdcffacac63 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:48.787174 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-21f0d135-a577-45e1-9ee3-9cdcffacac63 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:48.787842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-21f0d135-a577-45e1-9ee3-9cdcffacac63 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:48.794632 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-bd582a6e-ff19-4bee-b7a7-245ba7d15236 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:48.795471 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-bd582a6e-ff19-4bee-b7a7-245ba7d15236 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:48.802662 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bd582a6e-ff19-4bee-b7a7-245ba7d15236 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:48.803484 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bd582a6e-ff19-4bee-b7a7-245ba7d15236 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:48.805848 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bd582a6e-ff19-4bee-b7a7-245ba7d15236 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:48.806347 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bd582a6e-ff19-4bee-b7a7-245ba7d15236 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:48.979698 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-21f0d135-a577-45e1-9ee3-9cdcffacac63 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:48.992607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-21f0d135-a577-45e1-9ee3-9cdcffacac63 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.218094 May 13 14:54:48.993269 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 67/121] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:48 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:49.007774 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-87150f57-4e1a-48b7-93b2-86c3038d60bd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:49.008430 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-87150f57-4e1a-48b7-93b2-86c3038d60bd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:49.015350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-87150f57-4e1a-48b7-93b2-86c3038d60bd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:49.015839 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-bd582a6e-ff19-4bee-b7a7-245ba7d15236 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:49.016146 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-87150f57-4e1a-48b7-93b2-86c3038d60bd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:49.017068 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-87150f57-4e1a-48b7-93b2-86c3038d60bd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:49.017507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-87150f57-4e1a-48b7-93b2-86c3038d60bd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:49.024429 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-bd582a6e-ff19-4bee-b7a7-245ba7d15236 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.234980 May 13 14:54:49.033894 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 55/122] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:48 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:49.045634 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9e9ea774-c2a6-444f-9998-d313f857cbaf tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:49.046233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-9e9ea774-c2a6-444f-9998-d313f857cbaf tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:49.052345 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9e9ea774-c2a6-444f-9998-d313f857cbaf tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:49.052583 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9e9ea774-c2a6-444f-9998-d313f857cbaf tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:49.053352 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9e9ea774-c2a6-444f-9998-d313f857cbaf tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:49.053800 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9e9ea774-c2a6-444f-9998-d313f857cbaf tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:49.250090 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-87150f57-4e1a-48b7-93b2-86c3038d60bd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:49.254087 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9e9ea774-c2a6-444f-9998-d313f857cbaf tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:49.257889 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-87150f57-4e1a-48b7-93b2-86c3038d60bd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.254614 May 13 14:54:49.263566 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9e9ea774-c2a6-444f-9998-d313f857cbaf tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.221824 May 13 14:54:49.264292 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 56/123] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:49 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:49.277273 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 68/124] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:49 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:49.277373 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7a1c3326-cc7d-487e-863c-0db6c937bc24 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:49.277373 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7a1c3326-cc7d-487e-863c-0db6c937bc24 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:49.280554 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7a1c3326-cc7d-487e-863c-0db6c937bc24 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:49.281001 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7a1c3326-cc7d-487e-863c-0db6c937bc24 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:49.281778 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7a1c3326-cc7d-487e-863c-0db6c937bc24 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:49.282261 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7a1c3326-cc7d-487e-863c-0db6c937bc24 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:49.416383 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7a1c3326-cc7d-487e-863c-0db6c937bc24 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:49.424255 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7a1c3326-cc7d-487e-863c-0db6c937bc24 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:49.425809 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7a1c3326-cc7d-487e-863c-0db6c937bc24 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:49.426901 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7a1c3326-cc7d-487e-863c-0db6c937bc24 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.161301 May 13 14:54:49.427459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 57/125] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:49 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:50.009966 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9e66595c-27c6-4c99-b40e-c3af9b757224 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:50.010581 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9e66595c-27c6-4c99-b40e-c3af9b757224 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:50.017038 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9e66595c-27c6-4c99-b40e-c3af9b757224 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:50.017482 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9e66595c-27c6-4c99-b40e-c3af9b757224 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:50.018238 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9e66595c-27c6-4c99-b40e-c3af9b757224 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:50.018670 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9e66595c-27c6-4c99-b40e-c3af9b757224 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:50.041654 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8403ce5b-daa5-47b5-94cd-33978e647d3c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:50.042614 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8403ce5b-daa5-47b5-94cd-33978e647d3c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:50.049610 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8403ce5b-daa5-47b5-94cd-33978e647d3c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:50.050281 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8403ce5b-daa5-47b5-94cd-33978e647d3c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:50.051451 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8403ce5b-daa5-47b5-94cd-33978e647d3c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:50.052149 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8403ce5b-daa5-47b5-94cd-33978e647d3c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:50.248614 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9e66595c-27c6-4c99-b40e-c3af9b757224 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:50.256225 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8403ce5b-daa5-47b5-94cd-33978e647d3c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:50.264659 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8403ce5b-daa5-47b5-94cd-33978e647d3c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.226201 May 13 14:54:50.265759 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 58/126] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:50 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:50.266823 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9e66595c-27c6-4c99-b40e-c3af9b757224 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.260572 May 13 14:54:50.274469 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-0262a55a-d78d-42ce-bb01-b6c51a1ed959 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:50.275301 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-0262a55a-d78d-42ce-bb01-b6c51a1ed959 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:50.278038 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 69/127] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:50 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:50.282432 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0262a55a-d78d-42ce-bb01-b6c51a1ed959 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:50.283073 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0262a55a-d78d-42ce-bb01-b6c51a1ed959 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:50.284126 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0262a55a-d78d-42ce-bb01-b6c51a1ed959 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:50.284707 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0262a55a-d78d-42ce-bb01-b6c51a1ed959 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:50.290073 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-2ec1e1ac-cbea-46d1-972e-051d16563732 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:50.292966 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-2ec1e1ac-cbea-46d1-972e-051d16563732 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:50.300543 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2ec1e1ac-cbea-46d1-972e-051d16563732 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:50.301292 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2ec1e1ac-cbea-46d1-972e-051d16563732 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:50.302102 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2ec1e1ac-cbea-46d1-972e-051d16563732 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:50.302641 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2ec1e1ac-cbea-46d1-972e-051d16563732 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:50.506053 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-0262a55a-d78d-42ce-bb01-b6c51a1ed959 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:50.514265 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-0262a55a-d78d-42ce-bb01-b6c51a1ed959 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.243231 May 13 14:54:50.527557 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 59/128] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:50 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:50.532454 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9788dd69-9db0-4fb2-ba53-af6e5813059f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:50.533233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-9788dd69-9db0-4fb2-ba53-af6e5813059f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:50.539688 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9788dd69-9db0-4fb2-ba53-af6e5813059f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:50.540463 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9788dd69-9db0-4fb2-ba53-af6e5813059f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:50.541594 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9788dd69-9db0-4fb2-ba53-af6e5813059f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:50.542199 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9788dd69-9db0-4fb2-ba53-af6e5813059f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:50.573980 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-2ec1e1ac-cbea-46d1-972e-051d16563732 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:50.582377 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-2ec1e1ac-cbea-46d1-972e-051d16563732 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.301353 May 13 14:54:50.582957 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 70/129] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:50 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:50.714142 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9788dd69-9db0-4fb2-ba53-af6e5813059f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:50.726456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9788dd69-9db0-4fb2-ba53-af6e5813059f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:50.727985 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9788dd69-9db0-4fb2-ba53-af6e5813059f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:50.729154 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9788dd69-9db0-4fb2-ba53-af6e5813059f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.200558 May 13 14:54:50.740813 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 60/130] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:50 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:51.284220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3f6f949b-2e49-4396-a8c2-6a68a81f7c04 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:51.285703 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3f6f949b-2e49-4396-a8c2-6a68a81f7c04 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:51.288145 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e9984017-5d43-47ed-b249-dee98d08d2c3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:51.289525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-e9984017-5d43-47ed-b249-dee98d08d2c3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:51.294523 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3f6f949b-2e49-4396-a8c2-6a68a81f7c04 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:51.295513 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3f6f949b-2e49-4396-a8c2-6a68a81f7c04 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:51.296878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3f6f949b-2e49-4396-a8c2-6a68a81f7c04 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:51.297526 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3f6f949b-2e49-4396-a8c2-6a68a81f7c04 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:51.299088 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e9984017-5d43-47ed-b249-dee98d08d2c3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:51.300128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e9984017-5d43-47ed-b249-dee98d08d2c3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:51.301228 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e9984017-5d43-47ed-b249-dee98d08d2c3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:51.301663 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e9984017-5d43-47ed-b249-dee98d08d2c3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:51.545420 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e9984017-5d43-47ed-b249-dee98d08d2c3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:51.550960 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3f6f949b-2e49-4396-a8c2-6a68a81f7c04 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:51.555324 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e9984017-5d43-47ed-b249-dee98d08d2c3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.273021 May 13 14:54:51.559666 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3f6f949b-2e49-4396-a8c2-6a68a81f7c04 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.281453 May 13 14:54:51.560717 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 71/131] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:51 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:51.564036 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 61/132] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:51 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:51.574019 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-5313b4d6-b37d-4cc0-a39e-25ae16c81a08 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:51.574724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-5313b4d6-b37d-4cc0-a39e-25ae16c81a08 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:51.583137 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5313b4d6-b37d-4cc0-a39e-25ae16c81a08 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:51.583939 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5313b4d6-b37d-4cc0-a39e-25ae16c81a08 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:51.584868 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5313b4d6-b37d-4cc0-a39e-25ae16c81a08 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:51.585403 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5313b4d6-b37d-4cc0-a39e-25ae16c81a08 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:51.600940 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-0f1db98a-bcb9-4b72-8691-efb5141cefb7 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:51.601631 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-0f1db98a-bcb9-4b72-8691-efb5141cefb7 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:51.607744 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0f1db98a-bcb9-4b72-8691-efb5141cefb7 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:51.608264 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0f1db98a-bcb9-4b72-8691-efb5141cefb7 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:51.609044 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0f1db98a-bcb9-4b72-8691-efb5141cefb7 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:51.609474 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0f1db98a-bcb9-4b72-8691-efb5141cefb7 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:51.810308 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-5313b4d6-b37d-4cc0-a39e-25ae16c81a08 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:51.813532 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-0f1db98a-bcb9-4b72-8691-efb5141cefb7 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:51.818640 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-5313b4d6-b37d-4cc0-a39e-25ae16c81a08 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.257287 May 13 14:54:51.819237 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 72/133] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:51 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:51.821901 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-0f1db98a-bcb9-4b72-8691-efb5141cefb7 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.225445 May 13 14:54:51.822468 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 62/134] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:51 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:51.824254 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-51cf1d9a-119c-4721-8968-c67a6e042445 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:51.824855 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-51cf1d9a-119c-4721-8968-c67a6e042445 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:51.831495 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-51cf1d9a-119c-4721-8968-c67a6e042445 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:51.831979 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-51cf1d9a-119c-4721-8968-c67a6e042445 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:51.832751 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-51cf1d9a-119c-4721-8968-c67a6e042445 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:51.833183 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-51cf1d9a-119c-4721-8968-c67a6e042445 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:52.007299 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-51cf1d9a-119c-4721-8968-c67a6e042445 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:52.015581 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-51cf1d9a-119c-4721-8968-c67a6e042445 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:52.017173 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-51cf1d9a-119c-4721-8968-c67a6e042445 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:52.018323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-51cf1d9a-119c-4721-8968-c67a6e042445 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.198167 May 13 14:54:52.018926 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 73/135] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:51 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:52.581890 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-2897853b-7dcb-4f65-ba64-d1b01b736f70 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:52.582571 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-2897853b-7dcb-4f65-ba64-d1b01b736f70 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:52.583899 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-20f81eb4-7206-43d0-b27a-d2100628f709 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:52.584660 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-20f81eb4-7206-43d0-b27a-d2100628f709 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:52.593916 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-20f81eb4-7206-43d0-b27a-d2100628f709 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:52.594437 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-20f81eb4-7206-43d0-b27a-d2100628f709 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:52.596279 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-20f81eb4-7206-43d0-b27a-d2100628f709 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:52.596462 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2897853b-7dcb-4f65-ba64-d1b01b736f70 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:52.597327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-20f81eb4-7206-43d0-b27a-d2100628f709 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:52.598294 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2897853b-7dcb-4f65-ba64-d1b01b736f70 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:52.599463 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2897853b-7dcb-4f65-ba64-d1b01b736f70 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:52.599924 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2897853b-7dcb-4f65-ba64-d1b01b736f70 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:52.825403 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-2897853b-7dcb-4f65-ba64-d1b01b736f70 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:52.838737 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-2897853b-7dcb-4f65-ba64-d1b01b736f70 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.260690 May 13 14:54:52.850886 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 74/136] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:52 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:52.857067 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-ef9816b7-7993-477b-b0d5-14be1a6761ad req-4bdf40e2-01fc-450c-a146-dce2a6508845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96db69fe-6594-486c-96b3-545e6dbfa29b", "name": "network-vif-plugged", "status": "completed", "tag": "4fd5686b-8efb-4342-9683-06dad26579b5"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:52.871356 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-ef9816b7-7993-477b-b0d5-14be1a6761ad req-4bdf40e2-01fc-450c-a146-dce2a6508845 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:52.872700 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-ef9816b7-7993-477b-b0d5-14be1a6761ad req-4bdf40e2-01fc-450c-a146-dce2a6508845 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:52.884780 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-20f81eb4-7206-43d0-b27a-d2100628f709 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:52.900057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-20f81eb4-7206-43d0-b27a-d2100628f709 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.319543 May 13 14:54:52.905718 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-ef9816b7-7993-477b-b0d5-14be1a6761ad req-4bdf40e2-01fc-450c-a146-dce2a6508845 service nova] Creating event network-vif-plugged:4fd5686b-8efb-4342-9683-06dad26579b5 for instance 96db69fe-6594-486c-96b3-545e6dbfa29b on hv-cinder-83090 May 13 14:54:52.909474 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 63/137] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:52 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:52.913649 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-ef9816b7-7993-477b-b0d5-14be1a6761ad req-4bdf40e2-01fc-450c-a146-dce2a6508845 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061242 May 13 14:54:52.915026 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 75/138] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:54:52.923245 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-08a9f918-44f5-4570-9a27-bf0a6214a0f1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:52.923419 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-bff23326-018c-4d28-8136-ffab67e9140a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:52.923930 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-08a9f918-44f5-4570-9a27-bf0a6214a0f1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:52.925126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-bff23326-018c-4d28-8136-ffab67e9140a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:52.931683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bff23326-018c-4d28-8136-ffab67e9140a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:52.932943 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bff23326-018c-4d28-8136-ffab67e9140a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:52.934026 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bff23326-018c-4d28-8136-ffab67e9140a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:52.934463 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bff23326-018c-4d28-8136-ffab67e9140a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:52.945791 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-08a9f918-44f5-4570-9a27-bf0a6214a0f1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:52.946236 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-08a9f918-44f5-4570-9a27-bf0a6214a0f1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:52.947033 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-08a9f918-44f5-4570-9a27-bf0a6214a0f1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:52.947478 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-08a9f918-44f5-4570-9a27-bf0a6214a0f1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:53.176871 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-08a9f918-44f5-4570-9a27-bf0a6214a0f1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:53.185493 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-08a9f918-44f5-4570-9a27-bf0a6214a0f1 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.273800 May 13 14:54:53.195503 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 64/139] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:52 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:53.201252 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-18677fc9-6bd1-466d-b312-aa22c4d1d9f1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:53.202062 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-18677fc9-6bd1-466d-b312-aa22c4d1d9f1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:53.208528 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-18677fc9-6bd1-466d-b312-aa22c4d1d9f1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:53.209139 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-18677fc9-6bd1-466d-b312-aa22c4d1d9f1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:53.210613 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-18677fc9-6bd1-466d-b312-aa22c4d1d9f1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:53.211177 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-18677fc9-6bd1-466d-b312-aa22c4d1d9f1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:53.215899 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-bff23326-018c-4d28-8136-ffab67e9140a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:53.233397 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-bff23326-018c-4d28-8136-ffab67e9140a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.314758 May 13 14:54:53.234924 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 76/140] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:52 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:53.826372 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-18677fc9-6bd1-466d-b312-aa22c4d1d9f1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:53.837640 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-18677fc9-6bd1-466d-b312-aa22c4d1d9f1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:53.839135 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-18677fc9-6bd1-466d-b312-aa22c4d1d9f1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:53.840332 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-18677fc9-6bd1-466d-b312-aa22c4d1d9f1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.643424 May 13 14:54:53.840924 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 65/141] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:53 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:53.857442 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-5f1507c7-6f0a-4415-aab5-c5c4ace4a5eb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:53.858560 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-5f1507c7-6f0a-4415-aab5-c5c4ace4a5eb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:53.864522 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5f1507c7-6f0a-4415-aab5-c5c4ace4a5eb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:53.865171 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5f1507c7-6f0a-4415-aab5-c5c4ace4a5eb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:53.866092 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5f1507c7-6f0a-4415-aab5-c5c4ace4a5eb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:53.866662 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5f1507c7-6f0a-4415-aab5-c5c4ace4a5eb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:53.924128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-56d3c9a1-e42e-4dc9-91e6-5b402308fc90 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:53.924914 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-56d3c9a1-e42e-4dc9-91e6-5b402308fc90 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:53.933241 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-56d3c9a1-e42e-4dc9-91e6-5b402308fc90 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:53.934035 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-56d3c9a1-e42e-4dc9-91e6-5b402308fc90 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:53.935645 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-56d3c9a1-e42e-4dc9-91e6-5b402308fc90 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:53.936431 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-56d3c9a1-e42e-4dc9-91e6-5b402308fc90 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:54.495710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-5f1507c7-6f0a-4415-aab5-c5c4ace4a5eb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:54.504038 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-5f1507c7-6f0a-4415-aab5-c5c4ace4a5eb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.650573 May 13 14:54:54.513889 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 77/142] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:53 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:54.527134 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-56d3c9a1-e42e-4dc9-91e6-5b402308fc90 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:54.535153 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-8b43ac49-b13e-412f-bb76-fe94d1627070 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:54.535914 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-8b43ac49-b13e-412f-bb76-fe94d1627070 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:54.551039 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-56d3c9a1-e42e-4dc9-91e6-5b402308fc90 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.630922 May 13 14:54:54.551911 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 66/143] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:53 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:54.554579 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8b43ac49-b13e-412f-bb76-fe94d1627070 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:54.555023 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8b43ac49-b13e-412f-bb76-fe94d1627070 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:54.555850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8b43ac49-b13e-412f-bb76-fe94d1627070 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:54.556311 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8b43ac49-b13e-412f-bb76-fe94d1627070 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:54.557413 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7d8f3d97-b2dd-4e0f-9261-395db3185e64 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:54.558020 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7d8f3d97-b2dd-4e0f-9261-395db3185e64 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:54.574861 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7d8f3d97-b2dd-4e0f-9261-395db3185e64 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:54.575314 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7d8f3d97-b2dd-4e0f-9261-395db3185e64 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:54.576126 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7d8f3d97-b2dd-4e0f-9261-395db3185e64 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:54.576575 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7d8f3d97-b2dd-4e0f-9261-395db3185e64 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:54.895667 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7d8f3d97-b2dd-4e0f-9261-395db3185e64 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:54.896340 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-8b43ac49-b13e-412f-bb76-fe94d1627070 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:54.909233 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-8b43ac49-b13e-412f-bb76-fe94d1627070 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.392557 May 13 14:54:54.910758 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 78/144] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:54 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:54.918421 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d24f597a-7c3d-4a4b-a488-9970f78df4bb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:54.918611 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7d8f3d97-b2dd-4e0f-9261-395db3185e64 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.365481 May 13 14:54:54.919502 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d24f597a-7c3d-4a4b-a488-9970f78df4bb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:54.924368 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 67/145] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:54 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:54.943970 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d24f597a-7c3d-4a4b-a488-9970f78df4bb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:54.944585 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d24f597a-7c3d-4a4b-a488-9970f78df4bb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:54.945840 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d24f597a-7c3d-4a4b-a488-9970f78df4bb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:54.947722 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d24f597a-7c3d-4a4b-a488-9970f78df4bb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:54.956826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-fabb6913-0668-414b-8891-ce4207a8ffbf req-fd0324ef-ee52-4480-9ad1-c72df7e7c801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b68ffc-74f1-4850-ba58-9504e3b5c4c7", "name": "network-vif-plugged", "status": "completed", "tag": "9586d7b9-e756-4c7c-b9ba-629358746fdc"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:54.975321 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-fabb6913-0668-414b-8891-ce4207a8ffbf req-fd0324ef-ee52-4480-9ad1-c72df7e7c801 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:54.976117 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-fabb6913-0668-414b-8891-ce4207a8ffbf req-fd0324ef-ee52-4480-9ad1-c72df7e7c801 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:55.020706 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-fabb6913-0668-414b-8891-ce4207a8ffbf req-fd0324ef-ee52-4480-9ad1-c72df7e7c801 service nova] Creating event network-vif-plugged:9586d7b9-e756-4c7c-b9ba-629358746fdc for instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 on hv-cinder-83090 May 13 14:54:55.030936 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-fabb6913-0668-414b-8891-ce4207a8ffbf req-fd0324ef-ee52-4480-9ad1-c72df7e7c801 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078922 May 13 14:54:55.031656 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 68/146] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:54:55.221021 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d24f597a-7c3d-4a4b-a488-9970f78df4bb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:55.233575 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d24f597a-7c3d-4a4b-a488-9970f78df4bb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:55.235274 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d24f597a-7c3d-4a4b-a488-9970f78df4bb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:55.236522 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d24f597a-7c3d-4a4b-a488-9970f78df4bb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.323671 May 13 14:54:55.244378 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 79/147] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:54 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:55.525488 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-759f7b10-7e7e-418e-a1c4-5e4815b22b71 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:55.526738 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-759f7b10-7e7e-418e-a1c4-5e4815b22b71 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:55.537218 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-759f7b10-7e7e-418e-a1c4-5e4815b22b71 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:55.538315 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-759f7b10-7e7e-418e-a1c4-5e4815b22b71 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:55.539757 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-759f7b10-7e7e-418e-a1c4-5e4815b22b71 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:55.540573 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-759f7b10-7e7e-418e-a1c4-5e4815b22b71 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:55.571786 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-613f0f87-578d-4017-89cc-1d34352391f5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:55.573103 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-613f0f87-578d-4017-89cc-1d34352391f5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:55.580990 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-613f0f87-578d-4017-89cc-1d34352391f5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:55.581789 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-613f0f87-578d-4017-89cc-1d34352391f5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:55.582971 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-613f0f87-578d-4017-89cc-1d34352391f5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:55.583519 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-613f0f87-578d-4017-89cc-1d34352391f5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:55.784115 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-759f7b10-7e7e-418e-a1c4-5e4815b22b71 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:55.787747 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-613f0f87-578d-4017-89cc-1d34352391f5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:55.792792 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-759f7b10-7e7e-418e-a1c4-5e4815b22b71 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.274847 May 13 14:54:55.793383 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 69/148] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:55 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:55.803701 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-613f0f87-578d-4017-89cc-1d34352391f5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.236492 May 13 14:54:55.804368 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 80/149] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:55 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:55.926663 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f0620d97-10d3-406f-85f0-448349eb0538 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:55.927284 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f0620d97-10d3-406f-85f0-448349eb0538 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:55.933750 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f0620d97-10d3-406f-85f0-448349eb0538 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:55.934320 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f0620d97-10d3-406f-85f0-448349eb0538 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:55.935257 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f0620d97-10d3-406f-85f0-448349eb0538 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:55.935700 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f0620d97-10d3-406f-85f0-448349eb0538 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:55.946230 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-40e4ba11-ee2c-4d36-811a-dab5ce75b86b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:55.947132 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-40e4ba11-ee2c-4d36-811a-dab5ce75b86b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:55.957351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-40e4ba11-ee2c-4d36-811a-dab5ce75b86b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:55.959384 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-40e4ba11-ee2c-4d36-811a-dab5ce75b86b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:55.962146 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-40e4ba11-ee2c-4d36-811a-dab5ce75b86b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:55.962801 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-40e4ba11-ee2c-4d36-811a-dab5ce75b86b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:56.185345 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-40e4ba11-ee2c-4d36-811a-dab5ce75b86b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:56.189221 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f0620d97-10d3-406f-85f0-448349eb0538 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:56.193036 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-40e4ba11-ee2c-4d36-811a-dab5ce75b86b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.253371 May 13 14:54:56.193900 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 81/150] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:55 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:56.196967 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f0620d97-10d3-406f-85f0-448349eb0538 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.274173 May 13 14:54:56.197695 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 70/151] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:55 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:56.254499 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f523aeb5-aa87-4eb7-8648-2311e8b74cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:56.255077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f523aeb5-aa87-4eb7-8648-2311e8b74cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:56.261236 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f523aeb5-aa87-4eb7-8648-2311e8b74cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:56.261858 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f523aeb5-aa87-4eb7-8648-2311e8b74cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:56.262875 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f523aeb5-aa87-4eb7-8648-2311e8b74cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:56.263441 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f523aeb5-aa87-4eb7-8648-2311e8b74cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:56.403787 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f523aeb5-aa87-4eb7-8648-2311e8b74cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:56.413055 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f523aeb5-aa87-4eb7-8648-2311e8b74cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:56.414674 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f523aeb5-aa87-4eb7-8648-2311e8b74cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:56.416071 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f523aeb5-aa87-4eb7-8648-2311e8b74cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.165530 May 13 14:54:56.416738 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 82/152] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:56 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:56.812858 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-2e100130-7fd2-4989-a390-396c0364173d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:56.814930 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-2e100130-7fd2-4989-a390-396c0364173d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:56.821687 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-588dba43-6053-4de6-a5a4-47897c6bae95 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:56.822439 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-588dba43-6053-4de6-a5a4-47897c6bae95 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:56.832392 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-588dba43-6053-4de6-a5a4-47897c6bae95 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:56.832850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-588dba43-6053-4de6-a5a4-47897c6bae95 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:56.833386 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2e100130-7fd2-4989-a390-396c0364173d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:56.833926 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2e100130-7fd2-4989-a390-396c0364173d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:56.835019 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2e100130-7fd2-4989-a390-396c0364173d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:56.835557 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2e100130-7fd2-4989-a390-396c0364173d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:56.835655 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-588dba43-6053-4de6-a5a4-47897c6bae95 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:56.836037 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-588dba43-6053-4de6-a5a4-47897c6bae95 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:57.043094 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-588dba43-6053-4de6-a5a4-47897c6bae95 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:57.054432 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-588dba43-6053-4de6-a5a4-47897c6bae95 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.237365 May 13 14:54:57.055047 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 83/153] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:56 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:57.061646 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-2e100130-7fd2-4989-a390-396c0364173d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:57.068188 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-915984e4-c476-4753-97d7-c5e499727ac6 req-9cbf9044-90d7-4a87-9e46-ca42de8bda84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137f45b0-0ba4-4c2e-8588-b45112a1c7d7", "name": "network-vif-plugged", "status": "completed", "tag": "ee93aa72-1b63-48c8-bbd1-9a3c75bec1fe"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:54:57.076726 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-915984e4-c476-4753-97d7-c5e499727ac6 req-9cbf9044-90d7-4a87-9e46-ca42de8bda84 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:57.077632 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-915984e4-c476-4753-97d7-c5e499727ac6 req-9cbf9044-90d7-4a87-9e46-ca42de8bda84 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:57.079906 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-2e100130-7fd2-4989-a390-396c0364173d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.271138 May 13 14:54:57.081271 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 71/154] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:56 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:57.089449 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-915984e4-c476-4753-97d7-c5e499727ac6 req-9cbf9044-90d7-4a87-9e46-ca42de8bda84 service nova] Creating event network-vif-plugged:ee93aa72-1b63-48c8-bbd1-9a3c75bec1fe for instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 on hv-cinder-83090 May 13 14:54:57.094908 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-915984e4-c476-4753-97d7-c5e499727ac6 req-9cbf9044-90d7-4a87-9e46-ca42de8bda84 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030444 May 13 14:54:57.095679 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 84/155] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:54:57.211104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-74425ad3-5416-4302-af0f-9a8e15f82ec9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:57.212098 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-74425ad3-5416-4302-af0f-9a8e15f82ec9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:57.215712 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9444415e-083d-4e5e-9675-65a932d7dd33 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:57.216450 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9444415e-083d-4e5e-9675-65a932d7dd33 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:57.220171 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-74425ad3-5416-4302-af0f-9a8e15f82ec9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:57.220590 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-74425ad3-5416-4302-af0f-9a8e15f82ec9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:57.221546 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-74425ad3-5416-4302-af0f-9a8e15f82ec9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:57.222247 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-74425ad3-5416-4302-af0f-9a8e15f82ec9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:57.225543 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9444415e-083d-4e5e-9675-65a932d7dd33 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:57.225987 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9444415e-083d-4e5e-9675-65a932d7dd33 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:57.226754 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9444415e-083d-4e5e-9675-65a932d7dd33 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:57.227178 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9444415e-083d-4e5e-9675-65a932d7dd33 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:57.484412 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-74425ad3-5416-4302-af0f-9a8e15f82ec9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:57.488331 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9444415e-083d-4e5e-9675-65a932d7dd33 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:57.493132 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-74425ad3-5416-4302-af0f-9a8e15f82ec9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.286375 May 13 14:54:57.496776 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 72/156] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:57 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:57.497203 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9444415e-083d-4e5e-9675-65a932d7dd33 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.286478 May 13 14:54:57.502442 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1341d35c-f035-40b0-9ea1-17c87dc91e2e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:57.503266 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1341d35c-f035-40b0-9ea1-17c87dc91e2e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:57.504467 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 85/157] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:57 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:57.509216 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1341d35c-f035-40b0-9ea1-17c87dc91e2e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:57.509690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1341d35c-f035-40b0-9ea1-17c87dc91e2e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:57.510805 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1341d35c-f035-40b0-9ea1-17c87dc91e2e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:57.510914 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1341d35c-f035-40b0-9ea1-17c87dc91e2e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:57.640904 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1341d35c-f035-40b0-9ea1-17c87dc91e2e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:57.649544 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1341d35c-f035-40b0-9ea1-17c87dc91e2e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:57.651149 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1341d35c-f035-40b0-9ea1-17c87dc91e2e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:57.652327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1341d35c-f035-40b0-9ea1-17c87dc91e2e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.154405 May 13 14:54:57.652884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 73/158] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:57 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:58.072913 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-777abd12-64bd-4a69-b0a5-94fa2b8bc9b7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:58.073429 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-777abd12-64bd-4a69-b0a5-94fa2b8bc9b7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:58.080412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-777abd12-64bd-4a69-b0a5-94fa2b8bc9b7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:58.080855 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-777abd12-64bd-4a69-b0a5-94fa2b8bc9b7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:58.081639 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-777abd12-64bd-4a69-b0a5-94fa2b8bc9b7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:58.082063 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-777abd12-64bd-4a69-b0a5-94fa2b8bc9b7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:58.099647 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-db82fbae-1331-4e20-8732-be489a37d9ad tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:58.105689 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-db82fbae-1331-4e20-8732-be489a37d9ad tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:58.112612 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-db82fbae-1331-4e20-8732-be489a37d9ad tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:58.113130 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-db82fbae-1331-4e20-8732-be489a37d9ad tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:58.114057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-db82fbae-1331-4e20-8732-be489a37d9ad tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:58.114482 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-db82fbae-1331-4e20-8732-be489a37d9ad tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:58.285535 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-777abd12-64bd-4a69-b0a5-94fa2b8bc9b7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:58.293187 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-db82fbae-1331-4e20-8732-be489a37d9ad tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:58.294801 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-777abd12-64bd-4a69-b0a5-94fa2b8bc9b7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.225800 May 13 14:54:58.295402 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 86/159] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:58 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:58.301063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-db82fbae-1331-4e20-8732-be489a37d9ad tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.205514 May 13 14:54:58.301623 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 74/160] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:58 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:58.518331 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-22e844e3-7d40-4de4-ab7c-1e393520286d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:58.518460 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-421f045a-2c34-4ab8-8be3-e54158ce53b5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:58.518955 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-22e844e3-7d40-4de4-ab7c-1e393520286d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:58.519269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-421f045a-2c34-4ab8-8be3-e54158ce53b5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:58.527573 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-421f045a-2c34-4ab8-8be3-e54158ce53b5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:58.528058 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-421f045a-2c34-4ab8-8be3-e54158ce53b5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:58.528544 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-22e844e3-7d40-4de4-ab7c-1e393520286d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:58.528838 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-421f045a-2c34-4ab8-8be3-e54158ce53b5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:58.529087 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-22e844e3-7d40-4de4-ab7c-1e393520286d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:58.529430 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-421f045a-2c34-4ab8-8be3-e54158ce53b5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:58.530081 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-22e844e3-7d40-4de4-ab7c-1e393520286d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:58.530578 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-22e844e3-7d40-4de4-ab7c-1e393520286d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:58.729459 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-22e844e3-7d40-4de4-ab7c-1e393520286d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:58.734240 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-421f045a-2c34-4ab8-8be3-e54158ce53b5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:58.735495 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-22e844e3-7d40-4de4-ab7c-1e393520286d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.229370 May 13 14:54:58.736107 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 87/161] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:58 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:58.743354 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-421f045a-2c34-4ab8-8be3-e54158ce53b5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.232893 May 13 14:54:58.743960 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 75/162] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:58 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:58.748649 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3b3079d7-9ef7-4834-a1f4-639ff8d15eef tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:58.749505 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3b3079d7-9ef7-4834-a1f4-639ff8d15eef tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:58.755675 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3b3079d7-9ef7-4834-a1f4-639ff8d15eef tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:58.756142 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3b3079d7-9ef7-4834-a1f4-639ff8d15eef tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:58.756910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3b3079d7-9ef7-4834-a1f4-639ff8d15eef tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:58.757339 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3b3079d7-9ef7-4834-a1f4-639ff8d15eef tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:58.886919 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3b3079d7-9ef7-4834-a1f4-639ff8d15eef tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:58.894777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3b3079d7-9ef7-4834-a1f4-639ff8d15eef tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:58.896264 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3b3079d7-9ef7-4834-a1f4-639ff8d15eef tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:58.897354 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3b3079d7-9ef7-4834-a1f4-639ff8d15eef tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.160361 May 13 14:54:58.897933 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 88/163] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:58 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:54:59.310625 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-d5bc64f2-72a8-4046-acbb-e2fc1d92fda6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:59.312705 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-d5bc64f2-72a8-4046-acbb-e2fc1d92fda6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:59.317522 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-cb82472e-6882-47dc-9701-bb0dff455ff5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:59.317973 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d5bc64f2-72a8-4046-acbb-e2fc1d92fda6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:59.318058 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d5bc64f2-72a8-4046-acbb-e2fc1d92fda6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:59.318131 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-cb82472e-6882-47dc-9701-bb0dff455ff5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:59.318808 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d5bc64f2-72a8-4046-acbb-e2fc1d92fda6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:59.319293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d5bc64f2-72a8-4046-acbb-e2fc1d92fda6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:59.325189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cb82472e-6882-47dc-9701-bb0dff455ff5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:59.325882 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cb82472e-6882-47dc-9701-bb0dff455ff5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:59.326644 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cb82472e-6882-47dc-9701-bb0dff455ff5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:59.327714 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cb82472e-6882-47dc-9701-bb0dff455ff5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:59.548751 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-d5bc64f2-72a8-4046-acbb-e2fc1d92fda6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:59.559938 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-cb82472e-6882-47dc-9701-bb0dff455ff5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:59.569175 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-cb82472e-6882-47dc-9701-bb0dff455ff5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.255487 May 13 14:54:59.569559 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-d5bc64f2-72a8-4046-acbb-e2fc1d92fda6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.261401 May 13 14:54:59.570045 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 89/164] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:59 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:59.572401 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 76/165] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:59 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:59.753032 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-89f6978c-f91c-4a02-a69b-013e286d9cd4 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:59.753664 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-89f6978c-f91c-4a02-a69b-013e286d9cd4 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:59.759161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6483eb52-a416-4a2a-8d32-3453290836a3 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:59.759800 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6483eb52-a416-4a2a-8d32-3453290836a3 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:59.760093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-89f6978c-f91c-4a02-a69b-013e286d9cd4 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:59.760543 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-89f6978c-f91c-4a02-a69b-013e286d9cd4 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:59.761310 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-89f6978c-f91c-4a02-a69b-013e286d9cd4 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:59.761744 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-89f6978c-f91c-4a02-a69b-013e286d9cd4 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:59.765741 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6483eb52-a416-4a2a-8d32-3453290836a3 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:59.766229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6483eb52-a416-4a2a-8d32-3453290836a3 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:59.766962 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6483eb52-a416-4a2a-8d32-3453290836a3 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:59.767383 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6483eb52-a416-4a2a-8d32-3453290836a3 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:59.952294 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-89f6978c-f91c-4a02-a69b-013e286d9cd4 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:59.956106 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6483eb52-a416-4a2a-8d32-3453290836a3 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:54:59.960301 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-89f6978c-f91c-4a02-a69b-013e286d9cd4 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.211377 May 13 14:54:59.960920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 90/166] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:59 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:54:59.964256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6483eb52-a416-4a2a-8d32-3453290836a3 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.208874 May 13 14:54:59.965011 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 77/167] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:54:59 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:54:59.968014 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-fa88afb3-f4dc-4d4e-ba35-e158d6aaaf50 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:54:59.968625 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-fa88afb3-f4dc-4d4e-ba35-e158d6aaaf50 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:54:59.975604 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fa88afb3-f4dc-4d4e-ba35-e158d6aaaf50 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:59.976091 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fa88afb3-f4dc-4d4e-ba35-e158d6aaaf50 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:54:59.977188 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fa88afb3-f4dc-4d4e-ba35-e158d6aaaf50 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:54:59.977624 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fa88afb3-f4dc-4d4e-ba35-e158d6aaaf50 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:00.113289 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-fa88afb3-f4dc-4d4e-ba35-e158d6aaaf50 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:00.121536 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-fa88afb3-f4dc-4d4e-ba35-e158d6aaaf50 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:00.123027 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-fa88afb3-f4dc-4d4e-ba35-e158d6aaaf50 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:00.124168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-fa88afb3-f4dc-4d4e-ba35-e158d6aaaf50 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.161491 May 13 14:55:00.125262 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 91/168] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:54:59 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:55:00.592004 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a673134a-b3cd-4fdc-b9c4-b43c181fecc0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:00.593179 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a673134a-b3cd-4fdc-b9c4-b43c181fecc0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:00.593948 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-07f981c5-d3ac-4fb1-adbb-92abfdecd8cd tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:00.594568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-07f981c5-d3ac-4fb1-adbb-92abfdecd8cd tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:00.600227 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a673134a-b3cd-4fdc-b9c4-b43c181fecc0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:00.600709 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a673134a-b3cd-4fdc-b9c4-b43c181fecc0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:00.601190 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-07f981c5-d3ac-4fb1-adbb-92abfdecd8cd tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:00.601490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a673134a-b3cd-4fdc-b9c4-b43c181fecc0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:00.601620 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-07f981c5-d3ac-4fb1-adbb-92abfdecd8cd tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:00.601889 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a673134a-b3cd-4fdc-b9c4-b43c181fecc0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:00.602402 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-07f981c5-d3ac-4fb1-adbb-92abfdecd8cd tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:00.603074 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-07f981c5-d3ac-4fb1-adbb-92abfdecd8cd tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:00.793331 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-a673134a-b3cd-4fdc-b9c4-b43c181fecc0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:00.796878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-07f981c5-d3ac-4fb1-adbb-92abfdecd8cd tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:00.801198 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a673134a-b3cd-4fdc-b9c4-b43c181fecc0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.213181 May 13 14:55:00.801766 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 78/169] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:00 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:00.805918 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-07f981c5-d3ac-4fb1-adbb-92abfdecd8cd tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.215362 May 13 14:55:00.805918 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 92/170] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:00 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:00.978688 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1f7f79b1-edb4-4089-8caf-eff71f9ed084 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:00.979367 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1f7f79b1-edb4-4089-8caf-eff71f9ed084 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:00.982566 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-26df674d-5845-4878-bacd-771aaaaa39d3 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:00.983165 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-26df674d-5845-4878-bacd-771aaaaa39d3 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:00.988023 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f7f79b1-edb4-4089-8caf-eff71f9ed084 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:00.988470 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f7f79b1-edb4-4089-8caf-eff71f9ed084 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:00.990158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-26df674d-5845-4878-bacd-771aaaaa39d3 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:00.990623 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-26df674d-5845-4878-bacd-771aaaaa39d3 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:00.991261 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f7f79b1-edb4-4089-8caf-eff71f9ed084 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:00.991412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-26df674d-5845-4878-bacd-771aaaaa39d3 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:00.991703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f7f79b1-edb4-4089-8caf-eff71f9ed084 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:00.991987 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-26df674d-5845-4878-bacd-771aaaaa39d3 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:01.183552 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-26df674d-5845-4878-bacd-771aaaaa39d3 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:01.192131 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1f7f79b1-edb4-4089-8caf-eff71f9ed084 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:01.198375 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-26df674d-5845-4878-bacd-771aaaaa39d3 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.219953 May 13 14:55:01.198946 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 93/171] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:00 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:55:01.203477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1f7f79b1-edb4-4089-8caf-eff71f9ed084 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.229495 May 13 14:55:01.203650 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4c5fc944-fc1b-4c7f-9ec3-aafefe145850 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:01.204094 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 79/172] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:00 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:01.204258 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4c5fc944-fc1b-4c7f-9ec3-aafefe145850 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:01.211498 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4c5fc944-fc1b-4c7f-9ec3-aafefe145850 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:01.212041 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4c5fc944-fc1b-4c7f-9ec3-aafefe145850 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:01.213093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4c5fc944-fc1b-4c7f-9ec3-aafefe145850 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:01.213572 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4c5fc944-fc1b-4c7f-9ec3-aafefe145850 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:01.345930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4c5fc944-fc1b-4c7f-9ec3-aafefe145850 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:01.354441 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4c5fc944-fc1b-4c7f-9ec3-aafefe145850 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:01.355919 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4c5fc944-fc1b-4c7f-9ec3-aafefe145850 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:01.357059 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4c5fc944-fc1b-4c7f-9ec3-aafefe145850 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.157177 May 13 14:55:01.357630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 94/173] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:55:01 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:55:01.818399 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-d0d9a16e-699d-4cca-8fb0-6eb53e378ee2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:01.818996 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-d0d9a16e-699d-4cca-8fb0-6eb53e378ee2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:01.822026 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-1285b0a0-7b34-455b-a2c6-d5f81b673885 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:01.823259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-1285b0a0-7b34-455b-a2c6-d5f81b673885 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:01.825416 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d0d9a16e-699d-4cca-8fb0-6eb53e378ee2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:01.825871 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d0d9a16e-699d-4cca-8fb0-6eb53e378ee2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:01.826951 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d0d9a16e-699d-4cca-8fb0-6eb53e378ee2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:01.827606 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d0d9a16e-699d-4cca-8fb0-6eb53e378ee2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:01.831351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1285b0a0-7b34-455b-a2c6-d5f81b673885 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:01.831793 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1285b0a0-7b34-455b-a2c6-d5f81b673885 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:01.832586 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1285b0a0-7b34-455b-a2c6-d5f81b673885 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:01.833013 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1285b0a0-7b34-455b-a2c6-d5f81b673885 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:02.030488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-1285b0a0-7b34-455b-a2c6-d5f81b673885 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:02.034524 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-d0d9a16e-699d-4cca-8fb0-6eb53e378ee2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:02.043062 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-d0d9a16e-699d-4cca-8fb0-6eb53e378ee2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.228895 May 13 14:55:02.043401 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-1285b0a0-7b34-455b-a2c6-d5f81b673885 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.224884 May 13 14:55:02.053769 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 80/174] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:01 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:02.054413 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 95/175] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:01 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:02.214762 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b62b32aa-e707-450b-8b1a-1954e0420585 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:02.215583 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b62b32aa-e707-450b-8b1a-1954e0420585 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:02.220367 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-aa8e0533-9be3-47ea-91e9-335cc76113b2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:02.220944 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-aa8e0533-9be3-47ea-91e9-335cc76113b2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:02.223232 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b62b32aa-e707-450b-8b1a-1954e0420585 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:02.223993 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b62b32aa-e707-450b-8b1a-1954e0420585 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:02.225148 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b62b32aa-e707-450b-8b1a-1954e0420585 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:02.225609 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b62b32aa-e707-450b-8b1a-1954e0420585 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:02.227838 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-aa8e0533-9be3-47ea-91e9-335cc76113b2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:02.228332 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-aa8e0533-9be3-47ea-91e9-335cc76113b2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:02.229123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-aa8e0533-9be3-47ea-91e9-335cc76113b2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:02.230062 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-aa8e0533-9be3-47ea-91e9-335cc76113b2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:02.432106 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b62b32aa-e707-450b-8b1a-1954e0420585 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:02.435915 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-aa8e0533-9be3-47ea-91e9-335cc76113b2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:02.440431 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b62b32aa-e707-450b-8b1a-1954e0420585 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.229306 May 13 14:55:02.441070 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 81/176] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:02 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:02.445615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e79b1c44-8001-45fa-94de-20726c3c4cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:02.446206 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-e79b1c44-8001-45fa-94de-20726c3c4cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:02.453042 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-aa8e0533-9be3-47ea-91e9-335cc76113b2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.236322 May 13 14:55:02.453864 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 96/177] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:02 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:02.454602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e79b1c44-8001-45fa-94de-20726c3c4cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:02.455042 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e79b1c44-8001-45fa-94de-20726c3c4cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:02.455825 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e79b1c44-8001-45fa-94de-20726c3c4cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:02.456284 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e79b1c44-8001-45fa-94de-20726c3c4cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:02.586960 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e79b1c44-8001-45fa-94de-20726c3c4cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:02.595469 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e79b1c44-8001-45fa-94de-20726c3c4cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:02.597297 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e79b1c44-8001-45fa-94de-20726c3c4cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:02.598437 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e79b1c44-8001-45fa-94de-20726c3c4cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.156375 May 13 14:55:02.599025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 82/178] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:55:02 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:55:03.060711 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-95abd746-12d6-4c43-9646-916e8bc8e96f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:03.061247 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9f4c57b8-dc54-4ea1-ab22-40bad22cc0ae tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:03.061701 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-9f4c57b8-dc54-4ea1-ab22-40bad22cc0ae tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:03.062784 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-95abd746-12d6-4c43-9646-916e8bc8e96f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:03.069143 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9f4c57b8-dc54-4ea1-ab22-40bad22cc0ae tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:03.069803 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9f4c57b8-dc54-4ea1-ab22-40bad22cc0ae tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:03.071010 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9f4c57b8-dc54-4ea1-ab22-40bad22cc0ae tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:03.071393 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9f4c57b8-dc54-4ea1-ab22-40bad22cc0ae tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:03.073214 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-95abd746-12d6-4c43-9646-916e8bc8e96f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:03.074077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-95abd746-12d6-4c43-9646-916e8bc8e96f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:03.075182 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-95abd746-12d6-4c43-9646-916e8bc8e96f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:03.075724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-95abd746-12d6-4c43-9646-916e8bc8e96f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:03.300913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9f4c57b8-dc54-4ea1-ab22-40bad22cc0ae tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:03.308652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9f4c57b8-dc54-4ea1-ab22-40bad22cc0ae tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.251220 May 13 14:55:03.316110 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 83/179] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:03 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:03.316110 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-f4b6b19d-4ac7-44e8-8181-afaf40d3fb88 req-e00713bd-0efb-483f-8ecc-1d8e8df9a9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58eef483-5204-4068-bb39-476a857f0af1", "name": "network-vif-plugged", "status": "completed", "tag": "23f1961d-71e7-41fe-a16b-42eb34061faf"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:55:03.317076 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-95abd746-12d6-4c43-9646-916e8bc8e96f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:03.323608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-95abd746-12d6-4c43-9646-916e8bc8e96f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.267298 May 13 14:55:03.324247 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 97/180] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:03 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:03.329712 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-f4b6b19d-4ac7-44e8-8181-afaf40d3fb88 req-e00713bd-0efb-483f-8ecc-1d8e8df9a9e3 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:03.330309 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-f4b6b19d-4ac7-44e8-8181-afaf40d3fb88 req-e00713bd-0efb-483f-8ecc-1d8e8df9a9e3 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:03.342840 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-f4b6b19d-4ac7-44e8-8181-afaf40d3fb88 req-e00713bd-0efb-483f-8ecc-1d8e8df9a9e3 service nova] Creating event network-vif-plugged:23f1961d-71e7-41fe-a16b-42eb34061faf for instance 58eef483-5204-4068-bb39-476a857f0af1 on hv-cinder-83090 May 13 14:55:03.348474 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-f4b6b19d-4ac7-44e8-8181-afaf40d3fb88 req-e00713bd-0efb-483f-8ecc-1d8e8df9a9e3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037410 May 13 14:55:03.349183 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 84/181] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:55:03.456499 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-5b1c0300-c82c-48da-af0c-110ed4999ce7 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:03.457112 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-5b1c0300-c82c-48da-af0c-110ed4999ce7 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:03.463486 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5b1c0300-c82c-48da-af0c-110ed4999ce7 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:03.463948 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5b1c0300-c82c-48da-af0c-110ed4999ce7 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:03.464816 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5b1c0300-c82c-48da-af0c-110ed4999ce7 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:03.465253 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5b1c0300-c82c-48da-af0c-110ed4999ce7 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:03.470231 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-39749927-d530-44f2-854f-962a5d9b3e7e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:03.470992 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-39749927-d530-44f2-854f-962a5d9b3e7e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:03.477739 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-39749927-d530-44f2-854f-962a5d9b3e7e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:03.478174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-39749927-d530-44f2-854f-962a5d9b3e7e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:03.478940 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-39749927-d530-44f2-854f-962a5d9b3e7e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:03.479364 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-39749927-d530-44f2-854f-962a5d9b3e7e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:03.701317 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-5b1c0300-c82c-48da-af0c-110ed4999ce7 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:03.705049 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-39749927-d530-44f2-854f-962a5d9b3e7e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:03.709416 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-5b1c0300-c82c-48da-af0c-110ed4999ce7 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.256761 May 13 14:55:03.709991 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 98/182] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:03 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:03.713340 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-39749927-d530-44f2-854f-962a5d9b3e7e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.247566 May 13 14:55:03.715572 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-43b907ef-9eef-4fbc-bc34-165a31005792 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:03.716906 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-43b907ef-9eef-4fbc-bc34-165a31005792 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:03.723615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 85/183] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:03 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:55:03.731636 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-43b907ef-9eef-4fbc-bc34-165a31005792 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:03.732177 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-43b907ef-9eef-4fbc-bc34-165a31005792 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:03.733022 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-43b907ef-9eef-4fbc-bc34-165a31005792 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:03.733541 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-43b907ef-9eef-4fbc-bc34-165a31005792 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:03.868223 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-43b907ef-9eef-4fbc-bc34-165a31005792 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:03.876856 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-43b907ef-9eef-4fbc-bc34-165a31005792 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:03.878344 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-43b907ef-9eef-4fbc-bc34-165a31005792 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:03.879463 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-43b907ef-9eef-4fbc-bc34-165a31005792 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1406 microversion: 2.20 time: 0.168424 May 13 14:55:03.880103 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 99/184] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:55:03 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:55:04.326383 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-91f24f7f-d13e-4132-b26d-2eabb9f82c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:04.328008 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-91f24f7f-d13e-4132-b26d-2eabb9f82c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:04.334568 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-91f24f7f-d13e-4132-b26d-2eabb9f82c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:04.335281 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-91f24f7f-d13e-4132-b26d-2eabb9f82c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:04.345474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-5c2720d4-8ee6-453b-becf-6e54d2dceadf tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:04.346612 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-5c2720d4-8ee6-453b-becf-6e54d2dceadf tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:04.350681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-91f24f7f-d13e-4132-b26d-2eabb9f82c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:04.351183 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-91f24f7f-d13e-4132-b26d-2eabb9f82c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:04.360944 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5c2720d4-8ee6-453b-becf-6e54d2dceadf tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:04.361410 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5c2720d4-8ee6-453b-becf-6e54d2dceadf tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:04.362266 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5c2720d4-8ee6-453b-becf-6e54d2dceadf tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:04.362842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5c2720d4-8ee6-453b-becf-6e54d2dceadf tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:04.634746 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-91f24f7f-d13e-4132-b26d-2eabb9f82c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:04.645332 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-5c2720d4-8ee6-453b-becf-6e54d2dceadf tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:04.652462 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-91f24f7f-d13e-4132-b26d-2eabb9f82c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.330596 May 13 14:55:04.654461 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-5c2720d4-8ee6-453b-becf-6e54d2dceadf tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.315893 May 13 14:55:04.661963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 100/185] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:04 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:55:04.662485 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 86/186] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:04 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:55:04.731258 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6bc637b9-24e4-4741-aed7-3a3dd23aae0e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:04.734135 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f640c7f9-1878-4482-b1af-baafe14085a5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:04.743311 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6bc637b9-24e4-4741-aed7-3a3dd23aae0e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:04.745324 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f640c7f9-1878-4482-b1af-baafe14085a5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:04.767717 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f640c7f9-1878-4482-b1af-baafe14085a5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:04.777051 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6bc637b9-24e4-4741-aed7-3a3dd23aae0e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:04.780565 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6bc637b9-24e4-4741-aed7-3a3dd23aae0e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:04.781845 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6bc637b9-24e4-4741-aed7-3a3dd23aae0e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:04.784610 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f640c7f9-1878-4482-b1af-baafe14085a5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:04.785431 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6bc637b9-24e4-4741-aed7-3a3dd23aae0e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:04.786529 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f640c7f9-1878-4482-b1af-baafe14085a5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:04.792908 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f640c7f9-1878-4482-b1af-baafe14085a5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:05.340150 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6bc637b9-24e4-4741-aed7-3a3dd23aae0e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:05.352565 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6bc637b9-24e4-4741-aed7-3a3dd23aae0e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.625538 May 13 14:55:05.362153 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 87/187] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:04 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:55:05.362153 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-0c26a0e3-feec-4de9-88b3-1ff734fa317b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:05.362153 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-0c26a0e3-feec-4de9-88b3-1ff734fa317b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:05.362522 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f640c7f9-1878-4482-b1af-baafe14085a5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:05.369160 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0c26a0e3-feec-4de9-88b3-1ff734fa317b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:05.369600 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0c26a0e3-feec-4de9-88b3-1ff734fa317b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:05.369915 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f640c7f9-1878-4482-b1af-baafe14085a5 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.646589 May 13 14:55:05.370367 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0c26a0e3-feec-4de9-88b3-1ff734fa317b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:05.370822 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 101/188] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:04 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:05.370936 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0c26a0e3-feec-4de9-88b3-1ff734fa317b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:05.518217 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-0c26a0e3-feec-4de9-88b3-1ff734fa317b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:05.526829 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-0c26a0e3-feec-4de9-88b3-1ff734fa317b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:05.528584 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-0c26a0e3-feec-4de9-88b3-1ff734fa317b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:05.529748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-0c26a0e3-feec-4de9-88b3-1ff734fa317b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1599 microversion: 2.20 time: 0.175697 May 13 14:55:05.530306 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 88/189] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:55:05 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:55:05.549153 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ca00fcf0-5463-40d0-ba2a-a6aad587d618 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:05.549653 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ca00fcf0-5463-40d0-ba2a-a6aad587d618 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:05.555674 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ca00fcf0-5463-40d0-ba2a-a6aad587d618 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:05.556342 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ca00fcf0-5463-40d0-ba2a-a6aad587d618 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:05.557118 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ca00fcf0-5463-40d0-ba2a-a6aad587d618 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:05.557709 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ca00fcf0-5463-40d0-ba2a-a6aad587d618 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:05.672319 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5308b00e-841b-42a3-9bb8-c7b0e7dfe7ff tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:05.672319 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5308b00e-841b-42a3-9bb8-c7b0e7dfe7ff tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:05.679725 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5308b00e-841b-42a3-9bb8-c7b0e7dfe7ff tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:05.680643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5308b00e-841b-42a3-9bb8-c7b0e7dfe7ff tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:05.681725 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5308b00e-841b-42a3-9bb8-c7b0e7dfe7ff tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:05.682301 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5308b00e-841b-42a3-9bb8-c7b0e7dfe7ff tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:05.706362 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ca00fcf0-5463-40d0-ba2a-a6aad587d618 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.162543 May 13 14:55:05.707428 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 102/190] 10.222.0.99 () {60 vars in 1315 bytes} [Fri May 13 14:55:05 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:55:05.712829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-14088dc4-d929-4db3-bfe9-927f25ff596f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:05.713570 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-14088dc4-d929-4db3-bfe9-927f25ff596f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:05.725829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-14088dc4-d929-4db3-bfe9-927f25ff596f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:05.730136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-14088dc4-d929-4db3-bfe9-927f25ff596f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:05.731145 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-14088dc4-d929-4db3-bfe9-927f25ff596f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:05.732617 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-14088dc4-d929-4db3-bfe9-927f25ff596f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:06.233106 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5308b00e-841b-42a3-9bb8-c7b0e7dfe7ff tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:06.243122 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-14088dc4-d929-4db3-bfe9-927f25ff596f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:06.258356 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-14088dc4-d929-4db3-bfe9-927f25ff596f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.548195 May 13 14:55:06.259676 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 103/191] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:05 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:06.264751 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5308b00e-841b-42a3-9bb8-c7b0e7dfe7ff tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.599082 May 13 14:55:06.268444 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 89/192] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:05 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:55:06.369335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-7ad94a3c-3a4e-4b2c-aff5-7cf87316aa22 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:06.370091 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-7ad94a3c-3a4e-4b2c-aff5-7cf87316aa22 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:06.377999 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7ad94a3c-3a4e-4b2c-aff5-7cf87316aa22 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:06.378809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7ad94a3c-3a4e-4b2c-aff5-7cf87316aa22 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:06.379778 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7ad94a3c-3a4e-4b2c-aff5-7cf87316aa22 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:06.380391 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7ad94a3c-3a4e-4b2c-aff5-7cf87316aa22 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:06.386556 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1f62c026-ac6c-4afe-92d3-9ca7045b0bec tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:06.387160 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1f62c026-ac6c-4afe-92d3-9ca7045b0bec tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:06.396798 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f62c026-ac6c-4afe-92d3-9ca7045b0bec tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:06.397245 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f62c026-ac6c-4afe-92d3-9ca7045b0bec tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:06.398035 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f62c026-ac6c-4afe-92d3-9ca7045b0bec tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:06.398467 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f62c026-ac6c-4afe-92d3-9ca7045b0bec tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:07.013521 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1f62c026-ac6c-4afe-92d3-9ca7045b0bec tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:07.021376 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1f62c026-ac6c-4afe-92d3-9ca7045b0bec tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1315 microversion: 2.1 time: 0.638589 May 13 14:55:07.024360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 90/193] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:06 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:55:07.028841 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-7ad94a3c-3a4e-4b2c-aff5-7cf87316aa22 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:07.039283 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-7ad94a3c-3a4e-4b2c-aff5-7cf87316aa22 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.673658 May 13 14:55:07.039905 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 104/194] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:06 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:07.276797 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-50f11392-4ceb-444a-ae4b-0830563401dd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:07.277835 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-50f11392-4ceb-444a-ae4b-0830563401dd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:07.284774 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-01323382-91a4-4fed-a6d7-d92b9d646e20 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:07.285667 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-01323382-91a4-4fed-a6d7-d92b9d646e20 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:07.326980 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-50f11392-4ceb-444a-ae4b-0830563401dd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:07.329451 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-01323382-91a4-4fed-a6d7-d92b9d646e20 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:07.330233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-50f11392-4ceb-444a-ae4b-0830563401dd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:07.330900 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-01323382-91a4-4fed-a6d7-d92b9d646e20 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:07.331934 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-50f11392-4ceb-444a-ae4b-0830563401dd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:07.336696 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-01323382-91a4-4fed-a6d7-d92b9d646e20 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:07.337389 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-50f11392-4ceb-444a-ae4b-0830563401dd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:07.338133 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-01323382-91a4-4fed-a6d7-d92b9d646e20 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:07.675900 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-01323382-91a4-4fed-a6d7-d92b9d646e20 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:07.686598 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-01323382-91a4-4fed-a6d7-d92b9d646e20 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.406266 May 13 14:55:07.687546 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 105/195] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:07 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:55:07.692152 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-50f11392-4ceb-444a-ae4b-0830563401dd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:07.712011 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-50f11392-4ceb-444a-ae4b-0830563401dd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.438644 May 13 14:55:07.715130 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 91/196] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:07 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:08.045675 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-a6dda3bc-6815-4455-ac9a-5984a841e868 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:08.046926 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-a6dda3bc-6815-4455-ac9a-5984a841e868 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:08.055974 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ef9cc9bc-6326-4372-ab9e-c7df659e8005 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:08.056582 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ef9cc9bc-6326-4372-ab9e-c7df659e8005 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:08.065203 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a6dda3bc-6815-4455-ac9a-5984a841e868 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:08.067336 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ef9cc9bc-6326-4372-ab9e-c7df659e8005 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:08.068315 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ef9cc9bc-6326-4372-ab9e-c7df659e8005 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:08.069339 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ef9cc9bc-6326-4372-ab9e-c7df659e8005 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:08.069986 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ef9cc9bc-6326-4372-ab9e-c7df659e8005 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:08.070749 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a6dda3bc-6815-4455-ac9a-5984a841e868 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:08.074989 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a6dda3bc-6815-4455-ac9a-5984a841e868 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:08.076107 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a6dda3bc-6815-4455-ac9a-5984a841e868 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:08.415719 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ef9cc9bc-6326-4372-ab9e-c7df659e8005 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:08.426497 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ef9cc9bc-6326-4372-ab9e-c7df659e8005 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.372477 May 13 14:55:08.439166 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 92/197] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:08 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:55:08.451135 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-7845f5f2-3289-4f07-8541-2ce5725456a1 req-f81832cf-19e6-4c9f-b55b-f68c9b809dfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96db69fe-6594-486c-96b3-545e6dbfa29b", "tag": "4fd5686b-8efb-4342-9683-06dad26579b5"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:55:08.455024 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-a6dda3bc-6815-4455-ac9a-5984a841e868 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:08.464295 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-a6dda3bc-6815-4455-ac9a-5984a841e868 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1502 microversion: 2.1 time: 0.423030 May 13 14:55:08.474589 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-7845f5f2-3289-4f07-8541-2ce5725456a1 req-f81832cf-19e6-4c9f-b55b-f68c9b809dfc service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:08.475698 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-7845f5f2-3289-4f07-8541-2ce5725456a1 req-f81832cf-19e6-4c9f-b55b-f68c9b809dfc service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:08.480673 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 106/198] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:08 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1502 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:08.511917 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-7845f5f2-3289-4f07-8541-2ce5725456a1 req-f81832cf-19e6-4c9f-b55b-f68c9b809dfc service nova] Creating event network-changed:4fd5686b-8efb-4342-9683-06dad26579b5 for instance 96db69fe-6594-486c-96b3-545e6dbfa29b on hv-cinder-83090 May 13 14:55:08.528508 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-7845f5f2-3289-4f07-8541-2ce5725456a1 req-f81832cf-19e6-4c9f-b55b-f68c9b809dfc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087792 May 13 14:55:08.529149 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 93/199] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:55:08.705010 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d303fd34-ba21-4dc1-b180-17b5de6bfd18 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:08.705652 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d303fd34-ba21-4dc1-b180-17b5de6bfd18 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:08.721811 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d303fd34-ba21-4dc1-b180-17b5de6bfd18 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:08.722259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d303fd34-ba21-4dc1-b180-17b5de6bfd18 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:08.723077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d303fd34-ba21-4dc1-b180-17b5de6bfd18 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:08.723507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d303fd34-ba21-4dc1-b180-17b5de6bfd18 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:08.737957 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5a8f8f80-4eb3-4b34-802c-6b0e4ee815a6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:08.739345 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5a8f8f80-4eb3-4b34-802c-6b0e4ee815a6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:08.776251 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5a8f8f80-4eb3-4b34-802c-6b0e4ee815a6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:08.776842 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5a8f8f80-4eb3-4b34-802c-6b0e4ee815a6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:08.790624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5a8f8f80-4eb3-4b34-802c-6b0e4ee815a6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:08.791219 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5a8f8f80-4eb3-4b34-802c-6b0e4ee815a6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:09.261282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d303fd34-ba21-4dc1-b180-17b5de6bfd18 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:09.273586 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d303fd34-ba21-4dc1-b180-17b5de6bfd18 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1367 microversion: 2.1 time: 0.572585 May 13 14:55:09.283668 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5a8f8f80-4eb3-4b34-802c-6b0e4ee815a6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:09.285353 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 107/200] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:08 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1367 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:09.288156 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5a8f8f80-4eb3-4b34-802c-6b0e4ee815a6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.557613 May 13 14:55:09.289190 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 94/201] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:08 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:09.444906 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4314381e-9c2a-4d0b-b904-2fba5b67194f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:09.444906 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4314381e-9c2a-4d0b-b904-2fba5b67194f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:09.451259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4314381e-9c2a-4d0b-b904-2fba5b67194f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:09.451814 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4314381e-9c2a-4d0b-b904-2fba5b67194f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:09.452663 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4314381e-9c2a-4d0b-b904-2fba5b67194f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:09.453416 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4314381e-9c2a-4d0b-b904-2fba5b67194f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:09.706400 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4314381e-9c2a-4d0b-b904-2fba5b67194f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:09.722900 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4314381e-9c2a-4d0b-b904-2fba5b67194f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1364 microversion: 2.1 time: 0.281688 May 13 14:55:09.725197 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 108/202] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:09 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:10.179947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8ff9f20d-7895-44bb-8194-ff6290c4f99b tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b4efc7a-9606-4724-a72d-4f3756e5f19f"}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:55:10.181641 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8ff9f20d-7895-44bb-8194-ff6290c4f99b tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:10.189176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8ff9f20d-7895-44bb-8194-ff6290c4f99b tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:10.190196 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8ff9f20d-7895-44bb-8194-ff6290c4f99b tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:10.190971 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8ff9f20d-7895-44bb-8194-ff6290c4f99b tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:10.191452 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8ff9f20d-7895-44bb-8194-ff6290c4f99b tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:10.290796 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-56a7f113-0b0c-44a3-a26e-f8e9437b5f45 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:10.291400 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-56a7f113-0b0c-44a3-a26e-f8e9437b5f45 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:10.298539 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-56a7f113-0b0c-44a3-a26e-f8e9437b5f45 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:10.299180 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-56a7f113-0b0c-44a3-a26e-f8e9437b5f45 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:10.300120 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-56a7f113-0b0c-44a3-a26e-f8e9437b5f45 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:10.300721 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-56a7f113-0b0c-44a3-a26e-f8e9437b5f45 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:10.442088 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-56a7f113-0b0c-44a3-a26e-f8e9437b5f45 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:10.450353 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-56a7f113-0b0c-44a3-a26e-f8e9437b5f45 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1557 microversion: 2.1 time: 0.163512 May 13 14:55:10.463435 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 109/203] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:10 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1557 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:10.463435 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3d827a75-ec35-448d-a428-f2e150f9c348 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:10.463435 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3d827a75-ec35-448d-a428-f2e150f9c348 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:10.467631 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3d827a75-ec35-448d-a428-f2e150f9c348 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:10.468685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3d827a75-ec35-448d-a428-f2e150f9c348 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:10.469814 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3d827a75-ec35-448d-a428-f2e150f9c348 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:10.470405 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3d827a75-ec35-448d-a428-f2e150f9c348 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:10.650658 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3d827a75-ec35-448d-a428-f2e150f9c348 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:10.660056 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3d827a75-ec35-448d-a428-f2e150f9c348 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.207642 May 13 14:55:10.669824 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 110/204] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:10 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:10.675450 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9a9f1034-f27e-4160-972e-ddbf496166f1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:10.675977 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9a9f1034-f27e-4160-972e-ddbf496166f1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:10.684118 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9a9f1034-f27e-4160-972e-ddbf496166f1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:10.684764 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9a9f1034-f27e-4160-972e-ddbf496166f1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:10.685545 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9a9f1034-f27e-4160-972e-ddbf496166f1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:10.686403 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9a9f1034-f27e-4160-972e-ddbf496166f1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:10.785360 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9a9f1034-f27e-4160-972e-ddbf496166f1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113923 May 13 14:55:10.786172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 111/205] 10.222.0.99 () {58 vars in 1274 bytes} [Fri May 13 14:55:10 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:55:10.790666 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-0cdd0ad3-3885-4904-b02f-25892da1a711 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:10.791258 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-0cdd0ad3-3885-4904-b02f-25892da1a711 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:10.799811 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0cdd0ad3-3885-4904-b02f-25892da1a711 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:10.800493 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0cdd0ad3-3885-4904-b02f-25892da1a711 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:10.801265 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0cdd0ad3-3885-4904-b02f-25892da1a711 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:10.801849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0cdd0ad3-3885-4904-b02f-25892da1a711 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:11.100449 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-0cdd0ad3-3885-4904-b02f-25892da1a711 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:11.110258 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-0cdd0ad3-3885-4904-b02f-25892da1a711 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1549 microversion: 2.1 time: 0.323052 May 13 14:55:11.111798 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 112/206] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:10 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1549 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:11.130151 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-b371e46d-fdef-489b-bcaa-9e375c74789e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:11.130898 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-b371e46d-fdef-489b-bcaa-9e375c74789e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:11.137782 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b371e46d-fdef-489b-bcaa-9e375c74789e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:11.138457 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b371e46d-fdef-489b-bcaa-9e375c74789e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:11.139411 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b371e46d-fdef-489b-bcaa-9e375c74789e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:11.140121 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b371e46d-fdef-489b-bcaa-9e375c74789e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:11.268878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-b371e46d-fdef-489b-bcaa-9e375c74789e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143096 May 13 14:55:11.270057 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 113/207] 10.222.0.99 () {58 vars in 1274 bytes} [Fri May 13 14:55:11 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:55:11.679540 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-157f4203-3d07-4150-b35d-f1a7a8f192b4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:11.680628 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-157f4203-3d07-4150-b35d-f1a7a8f192b4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:11.691597 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-157f4203-3d07-4150-b35d-f1a7a8f192b4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:11.693549 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-157f4203-3d07-4150-b35d-f1a7a8f192b4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:11.696602 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-157f4203-3d07-4150-b35d-f1a7a8f192b4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:11.697324 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-157f4203-3d07-4150-b35d-f1a7a8f192b4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:11.975780 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-157f4203-3d07-4150-b35d-f1a7a8f192b4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:11.985248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-157f4203-3d07-4150-b35d-f1a7a8f192b4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.310294 May 13 14:55:11.985648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 114/208] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:11 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:55:12.455321 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-575f3e90-bdd1-4f93-90d2-ae36da9b5527 req-ee52fe14-d7bd-4dc9-8cdb-266df450a5cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "137f45b0-0ba4-4c2e-8588-b45112a1c7d7", "tag": "ee93aa72-1b63-48c8-bbd1-9a3c75bec1fe"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:55:12.464867 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-575f3e90-bdd1-4f93-90d2-ae36da9b5527 req-ee52fe14-d7bd-4dc9-8cdb-266df450a5cd service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:12.464867 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-575f3e90-bdd1-4f93-90d2-ae36da9b5527 req-ee52fe14-d7bd-4dc9-8cdb-266df450a5cd service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:12.484150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-575f3e90-bdd1-4f93-90d2-ae36da9b5527 req-ee52fe14-d7bd-4dc9-8cdb-266df450a5cd service nova] Creating event network-changed:ee93aa72-1b63-48c8-bbd1-9a3c75bec1fe for instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 on hv-cinder-83090 May 13 14:55:12.502713 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-575f3e90-bdd1-4f93-90d2-ae36da9b5527 req-ee52fe14-d7bd-4dc9-8cdb-266df450a5cd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051373 May 13 14:55:12.503526 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 115/209] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:55:13.007330 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e96aca02-4d5c-45a2-bad9-6111a2365717 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:13.009359 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e96aca02-4d5c-45a2-bad9-6111a2365717 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:13.025060 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e96aca02-4d5c-45a2-bad9-6111a2365717 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:13.025479 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e96aca02-4d5c-45a2-bad9-6111a2365717 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:13.026297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e96aca02-4d5c-45a2-bad9-6111a2365717 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:13.026727 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e96aca02-4d5c-45a2-bad9-6111a2365717 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:13.220276 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e96aca02-4d5c-45a2-bad9-6111a2365717 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:13.229893 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e96aca02-4d5c-45a2-bad9-6111a2365717 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.230114 May 13 14:55:13.230491 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 116/210] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:12 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:55:13.245322 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-911db282-c8ee-4744-99ef-1527a16bbb7c req-a44c9d25-7ce2-45de-938f-de447ac9687b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37b68ffc-74f1-4850-ba58-9504e3b5c4c7", "tag": "9586d7b9-e756-4c7c-b9ba-629358746fdc"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:55:13.255600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-911db282-c8ee-4744-99ef-1527a16bbb7c req-a44c9d25-7ce2-45de-938f-de447ac9687b service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:13.256102 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-911db282-c8ee-4744-99ef-1527a16bbb7c req-a44c9d25-7ce2-45de-938f-de447ac9687b service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:13.273657 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-911db282-c8ee-4744-99ef-1527a16bbb7c req-a44c9d25-7ce2-45de-938f-de447ac9687b service nova] Creating event network-changed:9586d7b9-e756-4c7c-b9ba-629358746fdc for instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 on hv-cinder-83090 May 13 14:55:13.282517 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-911db282-c8ee-4744-99ef-1527a16bbb7c req-a44c9d25-7ce2-45de-938f-de447ac9687b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040796 May 13 14:55:13.283407 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 117/211] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:55:14.248078 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-5d49e6d4-35ea-4922-a68a-180526446e35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:14.248785 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-5d49e6d4-35ea-4922-a68a-180526446e35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:14.255635 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5d49e6d4-35ea-4922-a68a-180526446e35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:14.256118 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5d49e6d4-35ea-4922-a68a-180526446e35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:14.256899 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5d49e6d4-35ea-4922-a68a-180526446e35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:14.257326 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5d49e6d4-35ea-4922-a68a-180526446e35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:14.391214 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-5d49e6d4-35ea-4922-a68a-180526446e35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:14.399038 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-5d49e6d4-35ea-4922-a68a-180526446e35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.155484 May 13 14:55:14.399617 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 118/212] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:14 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:55:15.420760 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9088c979-325c-4e15-a5af-c734838bd4de tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:15.421704 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9088c979-325c-4e15-a5af-c734838bd4de tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:15.432996 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9088c979-325c-4e15-a5af-c734838bd4de tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:15.433745 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9088c979-325c-4e15-a5af-c734838bd4de tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:15.435083 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9088c979-325c-4e15-a5af-c734838bd4de tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:15.435825 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9088c979-325c-4e15-a5af-c734838bd4de tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:15.574177 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9088c979-325c-4e15-a5af-c734838bd4de tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:15.582210 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9088c979-325c-4e15-a5af-c734838bd4de tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.169258 May 13 14:55:15.582801 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 119/213] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:15 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:16.602124 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-0ed151cf-3826-4b02-bc78-373a5bd66a2c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:16.603086 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-0ed151cf-3826-4b02-bc78-373a5bd66a2c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:16.611829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0ed151cf-3826-4b02-bc78-373a5bd66a2c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:16.612499 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0ed151cf-3826-4b02-bc78-373a5bd66a2c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:16.613602 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0ed151cf-3826-4b02-bc78-373a5bd66a2c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:16.614224 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0ed151cf-3826-4b02-bc78-373a5bd66a2c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:16.767974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-0ed151cf-3826-4b02-bc78-373a5bd66a2c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:16.776141 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-0ed151cf-3826-4b02-bc78-373a5bd66a2c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.180364 May 13 14:55:16.776715 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 120/214] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:16 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:17.793728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-fd86eca4-abab-42bd-baf3-2e086c74c330 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:17.794429 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-fd86eca4-abab-42bd-baf3-2e086c74c330 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:17.800902 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fd86eca4-abab-42bd-baf3-2e086c74c330 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:17.801345 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fd86eca4-abab-42bd-baf3-2e086c74c330 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:17.802122 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fd86eca4-abab-42bd-baf3-2e086c74c330 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:17.802556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fd86eca4-abab-42bd-baf3-2e086c74c330 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:17.948963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-fd86eca4-abab-42bd-baf3-2e086c74c330 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:17.956813 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-fd86eca4-abab-42bd-baf3-2e086c74c330 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.167045 May 13 14:55:17.957489 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 121/215] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:17 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:18.976431 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-8d7a4e60-124f-4585-85cc-29e225c1bd92 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:18.977126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-8d7a4e60-124f-4585-85cc-29e225c1bd92 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:18.983543 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8d7a4e60-124f-4585-85cc-29e225c1bd92 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:18.984153 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8d7a4e60-124f-4585-85cc-29e225c1bd92 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:18.984953 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8d7a4e60-124f-4585-85cc-29e225c1bd92 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:18.985383 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8d7a4e60-124f-4585-85cc-29e225c1bd92 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:19.123242 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-8d7a4e60-124f-4585-85cc-29e225c1bd92 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:19.132204 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-8d7a4e60-124f-4585-85cc-29e225c1bd92 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.161228 May 13 14:55:19.133023 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 122/216] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:18 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:20.149513 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d65399e8-f615-4a52-a1b3-7c53b9d03417 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:20.150161 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d65399e8-f615-4a52-a1b3-7c53b9d03417 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:20.156592 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d65399e8-f615-4a52-a1b3-7c53b9d03417 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:20.157024 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d65399e8-f615-4a52-a1b3-7c53b9d03417 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:20.157800 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d65399e8-f615-4a52-a1b3-7c53b9d03417 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:20.158217 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d65399e8-f615-4a52-a1b3-7c53b9d03417 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:20.287919 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d65399e8-f615-4a52-a1b3-7c53b9d03417 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:20.295777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d65399e8-f615-4a52-a1b3-7c53b9d03417 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.150506 May 13 14:55:20.296381 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 123/217] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:20 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:21.315363 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-0dbbb42a-c2fc-4b45-9847-4bd2c9272a53 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:21.316299 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-0dbbb42a-c2fc-4b45-9847-4bd2c9272a53 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:21.323110 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0dbbb42a-c2fc-4b45-9847-4bd2c9272a53 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:21.323558 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0dbbb42a-c2fc-4b45-9847-4bd2c9272a53 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:21.324378 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0dbbb42a-c2fc-4b45-9847-4bd2c9272a53 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:21.324809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0dbbb42a-c2fc-4b45-9847-4bd2c9272a53 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:21.458315 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-0dbbb42a-c2fc-4b45-9847-4bd2c9272a53 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:21.466450 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-0dbbb42a-c2fc-4b45-9847-4bd2c9272a53 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.157029 May 13 14:55:21.467051 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 124/218] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:21 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:55:22.234691 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8ff9f20d-7895-44bb-8194-ff6290c4f99b tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "POST /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.059572 May 13 14:55:22.240268 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 95/219] 10.222.0.99 () {60 vars in 1322 bytes} [Fri May 13 14:55:10 2022] POST /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61/os-volume_attachments => generated 194 bytes in 12061 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:55:22.483986 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-697508a6-fde5-4054-9ff1-7e6146ec6d44 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:22.487199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-697508a6-fde5-4054-9ff1-7e6146ec6d44 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:22.495532 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-697508a6-fde5-4054-9ff1-7e6146ec6d44 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:22.496079 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-697508a6-fde5-4054-9ff1-7e6146ec6d44 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:22.497114 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-697508a6-fde5-4054-9ff1-7e6146ec6d44 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:22.497769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-697508a6-fde5-4054-9ff1-7e6146ec6d44 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:22.644039 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-697508a6-fde5-4054-9ff1-7e6146ec6d44 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:22.654672 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-697508a6-fde5-4054-9ff1-7e6146ec6d44 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1321 microversion: 2.1 time: 0.174648 May 13 14:55:22.655257 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 125/220] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:22 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:23.673268 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-23520003-35b1-4c71-abb0-2879939dcdc3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:23.673967 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-23520003-35b1-4c71-abb0-2879939dcdc3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:23.681215 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-23520003-35b1-4c71-abb0-2879939dcdc3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:23.681663 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-23520003-35b1-4c71-abb0-2879939dcdc3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:23.682424 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-23520003-35b1-4c71-abb0-2879939dcdc3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:23.682851 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-23520003-35b1-4c71-abb0-2879939dcdc3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:23.831581 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-23520003-35b1-4c71-abb0-2879939dcdc3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:23.839623 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-23520003-35b1-4c71-abb0-2879939dcdc3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1516 microversion: 2.1 time: 0.171153 May 13 14:55:23.840239 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 96/221] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:23 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:23.857750 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ec3a309f-1298-4434-9d68-a30ae117c177 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:55:23.858860 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ec3a309f-1298-4434-9d68-a30ae117c177 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:23.865316 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ec3a309f-1298-4434-9d68-a30ae117c177 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:23.866084 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ec3a309f-1298-4434-9d68-a30ae117c177 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:23.867184 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ec3a309f-1298-4434-9d68-a30ae117c177 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:23.867859 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ec3a309f-1298-4434-9d68-a30ae117c177 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:23.891744 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-ec3a309f-1298-4434-9d68-a30ae117c177 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lazy-loading 'flavor' on Instance uuid 58eef483-5204-4068-bb39-476a857f0af1 {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:55:24.040982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ec3a309f-1298-4434-9d68-a30ae117c177 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "POST /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1/action" status: 200 len: 32 microversion: 2.1 time: 0.187613 May 13 14:55:24.041807 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 126/222] 10.222.0.99 () {60 vars in 1277 bytes} [Fri May 13 14:55:23 2022] POST /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1/action => generated 32 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 14:55:24.050944 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-12a68f51-21eb-45e8-9d08-752805fd7ab4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:24.051580 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-12a68f51-21eb-45e8-9d08-752805fd7ab4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:24.057931 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-12a68f51-21eb-45e8-9d08-752805fd7ab4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:24.058374 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-12a68f51-21eb-45e8-9d08-752805fd7ab4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:24.059139 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-12a68f51-21eb-45e8-9d08-752805fd7ab4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:24.059566 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-12a68f51-21eb-45e8-9d08-752805fd7ab4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:24.263048 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-12a68f51-21eb-45e8-9d08-752805fd7ab4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:24.271119 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-12a68f51-21eb-45e8-9d08-752805fd7ab4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.224154 May 13 14:55:24.271681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 97/223] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:24 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:25.292046 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-7971349a-b787-499e-8fa7-629f6148e322 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:25.292740 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-7971349a-b787-499e-8fa7-629f6148e322 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:25.299778 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7971349a-b787-499e-8fa7-629f6148e322 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:25.300252 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7971349a-b787-499e-8fa7-629f6148e322 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:25.300995 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7971349a-b787-499e-8fa7-629f6148e322 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:25.301456 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7971349a-b787-499e-8fa7-629f6148e322 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:25.445297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-7971349a-b787-499e-8fa7-629f6148e322 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:25.452907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-7971349a-b787-499e-8fa7-629f6148e322 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.166883 May 13 14:55:25.453461 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 127/224] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:25 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:26.470196 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-23c7f55e-f39d-441a-8ea5-aa37734d6532 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:26.471012 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-23c7f55e-f39d-441a-8ea5-aa37734d6532 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:26.477961 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-23c7f55e-f39d-441a-8ea5-aa37734d6532 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:26.478442 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-23c7f55e-f39d-441a-8ea5-aa37734d6532 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:26.479218 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-23c7f55e-f39d-441a-8ea5-aa37734d6532 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:26.479643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-23c7f55e-f39d-441a-8ea5-aa37734d6532 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:26.611044 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-23c7f55e-f39d-441a-8ea5-aa37734d6532 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:26.623320 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-23c7f55e-f39d-441a-8ea5-aa37734d6532 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.157087 May 13 14:55:26.624198 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 98/225] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:26 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:27.645157 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-70892079-95c1-42bc-a1dc-8e6d254d9cc1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:27.645760 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-70892079-95c1-42bc-a1dc-8e6d254d9cc1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:27.652722 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-70892079-95c1-42bc-a1dc-8e6d254d9cc1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:27.653167 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-70892079-95c1-42bc-a1dc-8e6d254d9cc1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:27.653939 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-70892079-95c1-42bc-a1dc-8e6d254d9cc1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:27.654376 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-70892079-95c1-42bc-a1dc-8e6d254d9cc1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:27.795497 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-70892079-95c1-42bc-a1dc-8e6d254d9cc1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:27.803307 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-70892079-95c1-42bc-a1dc-8e6d254d9cc1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.162264 May 13 14:55:27.803908 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 128/226] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:27 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:28.825282 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1f7214e2-f824-4425-a9da-4e4c2c18a9f3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:28.825846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1f7214e2-f824-4425-a9da-4e4c2c18a9f3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:28.832735 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f7214e2-f824-4425-a9da-4e4c2c18a9f3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:28.833187 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f7214e2-f824-4425-a9da-4e4c2c18a9f3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:28.833958 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f7214e2-f824-4425-a9da-4e4c2c18a9f3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:28.834390 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f7214e2-f824-4425-a9da-4e4c2c18a9f3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:28.973352 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1f7214e2-f824-4425-a9da-4e4c2c18a9f3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:28.982388 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1f7214e2-f824-4425-a9da-4e4c2c18a9f3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.164046 May 13 14:55:28.982966 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 99/227] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:28 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:29.999468 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-39443964-97ea-4d8e-aa2d-522a45d24141 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:30.000074 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-39443964-97ea-4d8e-aa2d-522a45d24141 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:30.006755 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-39443964-97ea-4d8e-aa2d-522a45d24141 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:30.007203 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-39443964-97ea-4d8e-aa2d-522a45d24141 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:30.008015 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-39443964-97ea-4d8e-aa2d-522a45d24141 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:30.008455 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-39443964-97ea-4d8e-aa2d-522a45d24141 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:30.150178 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-39443964-97ea-4d8e-aa2d-522a45d24141 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:30.157750 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-39443964-97ea-4d8e-aa2d-522a45d24141 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.162357 May 13 14:55:30.158327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 129/228] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:29 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:31.174854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a474ee68-d2e8-42fa-9014-7fe81d22a9c2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:31.175478 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a474ee68-d2e8-42fa-9014-7fe81d22a9c2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:31.183329 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a474ee68-d2e8-42fa-9014-7fe81d22a9c2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:31.183781 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a474ee68-d2e8-42fa-9014-7fe81d22a9c2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:31.184585 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a474ee68-d2e8-42fa-9014-7fe81d22a9c2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:31.185040 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a474ee68-d2e8-42fa-9014-7fe81d22a9c2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:31.327489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-a474ee68-d2e8-42fa-9014-7fe81d22a9c2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:31.335904 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a474ee68-d2e8-42fa-9014-7fe81d22a9c2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.165057 May 13 14:55:31.336469 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 100/229] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:31 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:32.357493 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-08fd07ea-13d9-4c67-9a9b-2e95216ac21e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:32.358668 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-08fd07ea-13d9-4c67-9a9b-2e95216ac21e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:32.369198 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-08fd07ea-13d9-4c67-9a9b-2e95216ac21e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:32.369926 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-08fd07ea-13d9-4c67-9a9b-2e95216ac21e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:32.371208 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-08fd07ea-13d9-4c67-9a9b-2e95216ac21e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:32.371923 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-08fd07ea-13d9-4c67-9a9b-2e95216ac21e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:32.511140 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-08fd07ea-13d9-4c67-9a9b-2e95216ac21e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:32.519144 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-08fd07ea-13d9-4c67-9a9b-2e95216ac21e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.168762 May 13 14:55:32.519721 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 130/230] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:32 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:33.536244 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-934679e4-f9fa-4442-86e7-63379d00357b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:33.536804 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-934679e4-f9fa-4442-86e7-63379d00357b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:33.543087 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-934679e4-f9fa-4442-86e7-63379d00357b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:33.543516 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-934679e4-f9fa-4442-86e7-63379d00357b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:33.544300 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-934679e4-f9fa-4442-86e7-63379d00357b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:33.544725 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-934679e4-f9fa-4442-86e7-63379d00357b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:33.677186 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-934679e4-f9fa-4442-86e7-63379d00357b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:33.686553 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-934679e4-f9fa-4442-86e7-63379d00357b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.154143 May 13 14:55:33.687149 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 101/231] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:33 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:34.703545 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-5d758b0b-e51f-48da-b1a3-ba5d3ed3d204 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:34.704197 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-5d758b0b-e51f-48da-b1a3-ba5d3ed3d204 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:34.711005 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5d758b0b-e51f-48da-b1a3-ba5d3ed3d204 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:34.711451 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5d758b0b-e51f-48da-b1a3-ba5d3ed3d204 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:34.712256 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5d758b0b-e51f-48da-b1a3-ba5d3ed3d204 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:34.712685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5d758b0b-e51f-48da-b1a3-ba5d3ed3d204 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:34.853287 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-5d758b0b-e51f-48da-b1a3-ba5d3ed3d204 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:34.861069 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-5d758b0b-e51f-48da-b1a3-ba5d3ed3d204 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.161393 May 13 14:55:34.862000 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 131/232] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:34 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:35.878302 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cce59765-b4a4-4f0f-849f-d35792f76ff6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:35.878907 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-cce59765-b4a4-4f0f-849f-d35792f76ff6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:35.885343 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cce59765-b4a4-4f0f-849f-d35792f76ff6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:35.885781 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cce59765-b4a4-4f0f-849f-d35792f76ff6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:35.886549 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cce59765-b4a4-4f0f-849f-d35792f76ff6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:35.886954 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cce59765-b4a4-4f0f-849f-d35792f76ff6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:36.028105 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-cce59765-b4a4-4f0f-849f-d35792f76ff6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:36.035928 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-cce59765-b4a4-4f0f-849f-d35792f76ff6 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.161389 May 13 14:55:36.036500 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 102/233] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:35 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:36.082737 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c326d513-b953-449e-a987-8a7c643b0cd4 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:36.083273 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c326d513-b953-449e-a987-8a7c643b0cd4 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:36.089653 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c326d513-b953-449e-a987-8a7c643b0cd4 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:36.090094 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c326d513-b953-449e-a987-8a7c643b0cd4 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:36.090856 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c326d513-b953-449e-a987-8a7c643b0cd4 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:36.091285 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c326d513-b953-449e-a987-8a7c643b0cd4 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:36.267194 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c326d513-b953-449e-a987-8a7c643b0cd4 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Going to try to terminate instance {{(pid=117295) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:55:36.357881 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c326d513-b953-449e-a987-8a7c643b0cd4 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "DELETE /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 204 len: 0 microversion: 2.1 time: 0.278307 May 13 14:55:36.358416 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 132/234] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 14:55:36 2022] DELETE /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:55:36.368746 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-24beb990-b377-4c8d-aaac-abbf029c6056 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:36.369349 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-24beb990-b377-4c8d-aaac-abbf029c6056 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:36.375425 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24beb990-b377-4c8d-aaac-abbf029c6056 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:36.375890 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24beb990-b377-4c8d-aaac-abbf029c6056 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:36.376673 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24beb990-b377-4c8d-aaac-abbf029c6056 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:36.377106 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24beb990-b377-4c8d-aaac-abbf029c6056 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:36.524568 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-24beb990-b377-4c8d-aaac-abbf029c6056 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:36.532436 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-24beb990-b377-4c8d-aaac-abbf029c6056 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1554 microversion: 2.1 time: 0.169646 May 13 14:55:36.533022 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 103/235] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:36 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:37.057465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-68875ac9-6570-4705-9cf9-678024a7080f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:37.058156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-68875ac9-6570-4705-9cf9-678024a7080f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:37.065070 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68875ac9-6570-4705-9cf9-678024a7080f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:37.065506 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68875ac9-6570-4705-9cf9-678024a7080f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:37.066270 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68875ac9-6570-4705-9cf9-678024a7080f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:37.066712 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68875ac9-6570-4705-9cf9-678024a7080f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:37.212170 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-68875ac9-6570-4705-9cf9-678024a7080f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:37.220274 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-68875ac9-6570-4705-9cf9-678024a7080f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.168930 May 13 14:55:37.220848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 133/236] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:37 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:37.550134 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-98afcb89-361b-4952-b969-042023a4d1cb tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:37.550725 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-98afcb89-361b-4952-b969-042023a4d1cb tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:37.557617 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-98afcb89-361b-4952-b969-042023a4d1cb tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:37.558063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-98afcb89-361b-4952-b969-042023a4d1cb tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:37.558835 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-98afcb89-361b-4952-b969-042023a4d1cb tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:37.559267 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-98afcb89-361b-4952-b969-042023a4d1cb tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:37.699284 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-98afcb89-361b-4952-b969-042023a4d1cb tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:37.707460 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-98afcb89-361b-4952-b969-042023a4d1cb tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1554 microversion: 2.1 time: 0.161228 May 13 14:55:37.708058 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 104/237] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:37 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:38.241053 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-5ea2bbe5-3cf8-4e93-b5a4-7d2fdb8ef9a9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:38.241557 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-5ea2bbe5-3cf8-4e93-b5a4-7d2fdb8ef9a9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:38.250495 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5ea2bbe5-3cf8-4e93-b5a4-7d2fdb8ef9a9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:38.251074 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5ea2bbe5-3cf8-4e93-b5a4-7d2fdb8ef9a9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:38.252274 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5ea2bbe5-3cf8-4e93-b5a4-7d2fdb8ef9a9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:38.252781 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5ea2bbe5-3cf8-4e93-b5a4-7d2fdb8ef9a9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:38.386533 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-5ea2bbe5-3cf8-4e93-b5a4-7d2fdb8ef9a9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:38.394751 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-5ea2bbe5-3cf8-4e93-b5a4-7d2fdb8ef9a9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.159956 May 13 14:55:38.395320 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 134/238] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:38 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:38.730118 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ce7850c6-1685-4496-8613-e8584833e66c tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:38.731053 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ce7850c6-1685-4496-8613-e8584833e66c tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:38.742202 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ce7850c6-1685-4496-8613-e8584833e66c tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:38.742899 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ce7850c6-1685-4496-8613-e8584833e66c tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:38.744239 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ce7850c6-1685-4496-8613-e8584833e66c tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:38.744953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ce7850c6-1685-4496-8613-e8584833e66c tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:38.889089 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ce7850c6-1685-4496-8613-e8584833e66c tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:38.897858 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ce7850c6-1685-4496-8613-e8584833e66c tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1554 microversion: 2.1 time: 0.174759 May 13 14:55:38.898437 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 105/239] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:38 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:39.412545 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-fc5c0db5-60f5-42b3-b954-4392eb03bde9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:39.413139 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-fc5c0db5-60f5-42b3-b954-4392eb03bde9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:39.419194 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fc5c0db5-60f5-42b3-b954-4392eb03bde9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:39.419628 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fc5c0db5-60f5-42b3-b954-4392eb03bde9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:39.420450 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fc5c0db5-60f5-42b3-b954-4392eb03bde9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:39.420889 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fc5c0db5-60f5-42b3-b954-4392eb03bde9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:39.559759 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-fc5c0db5-60f5-42b3-b954-4392eb03bde9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:39.568366 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-fc5c0db5-60f5-42b3-b954-4392eb03bde9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.159685 May 13 14:55:39.568941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 135/240] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:39 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:39.916225 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-32ec12f3-d5c7-4cdb-8840-b276d024feaf tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:39.916839 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-32ec12f3-d5c7-4cdb-8840-b276d024feaf tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:39.923199 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-32ec12f3-d5c7-4cdb-8840-b276d024feaf tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:39.923643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-32ec12f3-d5c7-4cdb-8840-b276d024feaf tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:39.924470 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-32ec12f3-d5c7-4cdb-8840-b276d024feaf tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:39.924895 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-32ec12f3-d5c7-4cdb-8840-b276d024feaf tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:39.984706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-2147432b-7cf0-46c2-9fc7-1b645a02c1ef req-e964564f-db57-472e-ab9f-4e3d46977409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1542a35b-8d51-4329-89e1-e68453edcb61", "name": "network-vif-deleted", "tag": "b9563ab0-d4b8-426f-af56-b221edbff1ee"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:55:39.993962 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-2147432b-7cf0-46c2-9fc7-1b645a02c1ef req-e964564f-db57-472e-ab9f-4e3d46977409 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:39.994611 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-2147432b-7cf0-46c2-9fc7-1b645a02c1ef req-e964564f-db57-472e-ab9f-4e3d46977409 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:39.995991 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-32ec12f3-d5c7-4cdb-8840-b276d024feaf tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:40.004467 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-32ec12f3-d5c7-4cdb-8840-b276d024feaf tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1512 microversion: 2.1 time: 0.093684 May 13 14:55:40.005133 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 106/241] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:39 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1512 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:40.006285 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-2147432b-7cf0-46c2-9fc7-1b645a02c1ef req-e964564f-db57-472e-ab9f-4e3d46977409 service nova] Creating event network-vif-deleted:b9563ab0-d4b8-426f-af56-b221edbff1ee for instance 1542a35b-8d51-4329-89e1-e68453edcb61 on hv-cinder-83090 May 13 14:55:40.016315 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-2147432b-7cf0-46c2-9fc7-1b645a02c1ef req-e964564f-db57-472e-ab9f-4e3d46977409 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035813 May 13 14:55:40.017049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 136/242] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:55:40.585480 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-4662b279-5125-4c03-8a35-7961576e10ed tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:40.586368 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-4662b279-5125-4c03-8a35-7961576e10ed tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:40.592780 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4662b279-5125-4c03-8a35-7961576e10ed tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:40.593258 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4662b279-5125-4c03-8a35-7961576e10ed tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:40.594017 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4662b279-5125-4c03-8a35-7961576e10ed tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:40.594439 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4662b279-5125-4c03-8a35-7961576e10ed tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:40.724288 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-4662b279-5125-4c03-8a35-7961576e10ed tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:40.732522 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-4662b279-5125-4c03-8a35-7961576e10ed tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.150863 May 13 14:55:40.733068 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 107/243] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:40 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:41.022537 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-684ed74e-cb0f-47c2-954b-dcf3d4f132d6 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:41.023227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-684ed74e-cb0f-47c2-954b-dcf3d4f132d6 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:41.044293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-684ed74e-cb0f-47c2-954b-dcf3d4f132d6 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:41.045605 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-684ed74e-cb0f-47c2-954b-dcf3d4f132d6 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:41.046543 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-684ed74e-cb0f-47c2-954b-dcf3d4f132d6 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:41.047072 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-684ed74e-cb0f-47c2-954b-dcf3d4f132d6 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:41.082529 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-684ed74e-cb0f-47c2-954b-dcf3d4f132d6 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:41.082995 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-684ed74e-cb0f-47c2-954b-dcf3d4f132d6 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:41.083425 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-684ed74e-cb0f-47c2-954b-dcf3d4f132d6 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lazy-loading 'fault' on Instance uuid 1542a35b-8d51-4329-89e1-e68453edcb61 {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:55:41.137319 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-684ed74e-cb0f-47c2-954b-dcf3d4f132d6 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '461f929b4237427791b49ec3cb465091', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8159266bb76747dc8687d5884241dd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:41.151299 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-684ed74e-cb0f-47c2-954b-dcf3d4f132d6 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 200 len: 1305 microversion: 2.1 time: 0.133187 May 13 14:55:41.152386 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 137/244] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:41 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 1305 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:41.749280 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-73a92f77-0f4e-4a5c-84cc-acd91e40a275 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:41.749863 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-73a92f77-0f4e-4a5c-84cc-acd91e40a275 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:41.756202 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-73a92f77-0f4e-4a5c-84cc-acd91e40a275 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:41.756660 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-73a92f77-0f4e-4a5c-84cc-acd91e40a275 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:41.757699 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-73a92f77-0f4e-4a5c-84cc-acd91e40a275 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:41.758132 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-73a92f77-0f4e-4a5c-84cc-acd91e40a275 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:41.887566 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-73a92f77-0f4e-4a5c-84cc-acd91e40a275 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:41.895029 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-73a92f77-0f4e-4a5c-84cc-acd91e40a275 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.149700 May 13 14:55:41.895601 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 108/245] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:41 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:42.170497 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4ac6ff4b-5665-4b1e-8a25-2be25c1d2247 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:42.171103 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4ac6ff4b-5665-4b1e-8a25-2be25c1d2247 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:42.179536 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4ac6ff4b-5665-4b1e-8a25-2be25c1d2247 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:42.180016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4ac6ff4b-5665-4b1e-8a25-2be25c1d2247 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:42.180794 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4ac6ff4b-5665-4b1e-8a25-2be25c1d2247 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:42.181208 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4ac6ff4b-5665-4b1e-8a25-2be25c1d2247 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:42.195588 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-4ac6ff4b-5665-4b1e-8a25-2be25c1d2247 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] HTTP exception thrown: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4ac6ff4b-5665-4b1e-8a25-2be25c1d2247 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Request method failure captured: May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 HTTP/1.1 May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnEHD4DyYWedCn3n2XI7ZdL4cBAo6ZU9QS85TwOkvAux4dBtUY4Hr0pXYoud-K0-74le6o7k2g_X95GBOX_NVs6QCGB3lyexdwOgwsVhyORCaYESU19zkTzLAfYVGGowf2Sdkgy4QS8MY8pKqg45mVt5xx9D5EP2sizLNR8Qr6qLDZU May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 8159266bb76747dc8687d5884241dd29 May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-DeleteServersTestJSON-1599111740 May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 14:55:42.200156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 14:55:42.201821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8159266bb76747dc8687d5884241dd29", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8159266bb76747dc8687d5884241dd29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8159266bb76747dc8687d5884241dd29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8159266bb76747dc8687d5884241dd29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:55:42.201821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-DeleteServersTestJSON-1599111740 May 13 14:55:42.201821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 8159266bb76747dc8687d5884241dd29 May 13 14:55:42.201821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-DeleteServersTestJSON-1599111740 May 13 14:55:42.201821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-DeleteServersTestJSON-1599111740-project May 13 14:55:42.201821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 14:55:42.201821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 14:55:42.201821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 461f929b4237427791b49ec3cb465091 May 13 14:55:42.201821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-DeleteServersTestJSON-1599111740-project May 13 14:55:42.201821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 14:55:42.201821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:42.201821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '1542a35b-8d51-4329-89e1-e68453edcb61'} May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:55:42.205907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:42.208293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:55:42.210752 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4ac6ff4b-5665-4b1e-8a25-2be25c1d2247 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Returning 404 to user: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:55:42.210752 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4ac6ff4b-5665-4b1e-8a25-2be25c1d2247 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 404 len: 111 microversion: 2.1 time: 0.035101 May 13 14:55:42.210752 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 138/246] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:42 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:55:42.316500 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5bbc31e6-5bcb-4e90-93f7-fb2fcb2ef15d tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:42.317781 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5bbc31e6-5bcb-4e90-93f7-fb2fcb2ef15d tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:42.324730 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5bbc31e6-5bcb-4e90-93f7-fb2fcb2ef15d tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:42.325213 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5bbc31e6-5bcb-4e90-93f7-fb2fcb2ef15d tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:42.325980 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5bbc31e6-5bcb-4e90-93f7-fb2fcb2ef15d tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:42.326529 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5bbc31e6-5bcb-4e90-93f7-fb2fcb2ef15d tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:42.339984 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-5bbc31e6-5bcb-4e90-93f7-fb2fcb2ef15d tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] HTTP exception thrown: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5bbc31e6-5bcb-4e90-93f7-fb2fcb2ef15d tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Request method failure captured: May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61/os-volume_attachments HTTP/1.1 May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnEHD4DyYWedCn3n2XI7ZdL4cBAo6ZU9QS85TwOkvAux4dBtUY4Hr0pXYoud-K0-74le6o7k2g_X95GBOX_NVs6QCGB3lyexdwOgwsVhyORCaYESU19zkTzLAfYVGGowf2Sdkgy4QS8MY8pKqg45mVt5xx9D5EP2sizLNR8Qr6qLDZU May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 8159266bb76747dc8687d5884241dd29 May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-DeleteServersTestJSON-1599111740 May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 14:55:42.344643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 14:55:42.345884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8159266bb76747dc8687d5884241dd29", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8159266bb76747dc8687d5884241dd29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8159266bb76747dc8687d5884241dd29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8159266bb76747dc8687d5884241dd29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:55:42.345884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-DeleteServersTestJSON-1599111740 May 13 14:55:42.345884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 8159266bb76747dc8687d5884241dd29 May 13 14:55:42.345884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-DeleteServersTestJSON-1599111740 May 13 14:55:42.345884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-DeleteServersTestJSON-1599111740-project May 13 14:55:42.345884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 14:55:42.345884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 14:55:42.345884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: 461f929b4237427791b49ec3cb465091 May 13 14:55:42.345884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-DeleteServersTestJSON-1599111740-project May 13 14:55:42.345884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 14:55:42.345884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:42.345884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'server_id': '1542a35b-8d51-4329-89e1-e68453edcb61'} May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:55:42.346624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:42.348164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:55:42.349300 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5bbc31e6-5bcb-4e90-93f7-fb2fcb2ef15d tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Returning 404 to user: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:55:42.349300 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5bbc31e6-5bcb-4e90-93f7-fb2fcb2ef15d tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033946 May 13 14:55:42.349300 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 109/247] 10.222.0.99 () {58 vars in 1301 bytes} [Fri May 13 14:55:42 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:55:42.912797 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-1bb02f37-745a-4e93-8071-62287e415383 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:42.913614 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-1bb02f37-745a-4e93-8071-62287e415383 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:42.920557 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1bb02f37-745a-4e93-8071-62287e415383 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:42.921240 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1bb02f37-745a-4e93-8071-62287e415383 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:42.922310 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1bb02f37-745a-4e93-8071-62287e415383 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:42.923044 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1bb02f37-745a-4e93-8071-62287e415383 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:43.070052 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-1bb02f37-745a-4e93-8071-62287e415383 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:43.077794 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-1bb02f37-745a-4e93-8071-62287e415383 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.169359 May 13 14:55:43.078295 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 139/248] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:42 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:43.551608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-370291dd-f1de-48b1-8430-d367f878e6cd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:43.552159 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-370291dd-f1de-48b1-8430-d367f878e6cd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:43.558678 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-370291dd-f1de-48b1-8430-d367f878e6cd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:43.559124 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-370291dd-f1de-48b1-8430-d367f878e6cd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:43.560051 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-370291dd-f1de-48b1-8430-d367f878e6cd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:43.560605 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-370291dd-f1de-48b1-8430-d367f878e6cd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:43.573907 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-370291dd-f1de-48b1-8430-d367f878e6cd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] HTTP exception thrown: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-370291dd-f1de-48b1-8430-d367f878e6cd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Request method failure captured: May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: DELETE /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 HTTP/1.1 May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnEHD4DyYWedCn3n2XI7ZdL4cBAo6ZU9QS85TwOkvAux4dBtUY4Hr0pXYoud-K0-74le6o7k2g_X95GBOX_NVs6QCGB3lyexdwOgwsVhyORCaYESU19zkTzLAfYVGGowf2Sdkgy4QS8MY8pKqg45mVt5xx9D5EP2sizLNR8Qr6qLDZU May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 8159266bb76747dc8687d5884241dd29 May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-DeleteServersTestJSON-1599111740 May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 14:55:43.576353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 14:55:43.577611 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8159266bb76747dc8687d5884241dd29", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8159266bb76747dc8687d5884241dd29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8159266bb76747dc8687d5884241dd29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8159266bb76747dc8687d5884241dd29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:55:43.577611 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-DeleteServersTestJSON-1599111740 May 13 14:55:43.577611 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 8159266bb76747dc8687d5884241dd29 May 13 14:55:43.577611 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-DeleteServersTestJSON-1599111740 May 13 14:55:43.577611 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-DeleteServersTestJSON-1599111740-project May 13 14:55:43.577611 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 14:55:43.577611 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 14:55:43.577611 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: 461f929b4237427791b49ec3cb465091 May 13 14:55:43.577611 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-DeleteServersTestJSON-1599111740-project May 13 14:55:43.577611 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 14:55:43.577611 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:43.577611 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': '1542a35b-8d51-4329-89e1-e68453edcb61'} May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:55:43.578263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:43.580104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:55:43.581373 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-370291dd-f1de-48b1-8430-d367f878e6cd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Returning 404 to user: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:55:43.581373 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-370291dd-f1de-48b1-8430-d367f878e6cd tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "DELETE /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 404 len: 111 microversion: 2.1 time: 0.030099 May 13 14:55:43.581373 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 110/249] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 14:55:43 2022] DELETE /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:55:43.586362 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-82ea4ce6-9a41-4bea-bc00-4ae1e4901e49 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:43.586972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-82ea4ce6-9a41-4bea-bc00-4ae1e4901e49 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] [instance: 1542a35b-8d51-4329-89e1-e68453edcb61] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:43.593289 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-82ea4ce6-9a41-4bea-bc00-4ae1e4901e49 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:43.593732 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-82ea4ce6-9a41-4bea-bc00-4ae1e4901e49 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:43.594499 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-82ea4ce6-9a41-4bea-bc00-4ae1e4901e49 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:43.594931 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-82ea4ce6-9a41-4bea-bc00-4ae1e4901e49 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:43.609640 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-82ea4ce6-9a41-4bea-bc00-4ae1e4901e49 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] HTTP exception thrown: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-82ea4ce6-9a41-4bea-bc00-4ae1e4901e49 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Request method failure captured: May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 HTTP/1.1 May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnEHD4DyYWedCn3n2XI7ZdL4cBAo6ZU9QS85TwOkvAux4dBtUY4Hr0pXYoud-K0-74le6o7k2g_X95GBOX_NVs6QCGB3lyexdwOgwsVhyORCaYESU19zkTzLAfYVGGowf2Sdkgy4QS8MY8pKqg45mVt5xx9D5EP2sizLNR8Qr6qLDZU May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 8159266bb76747dc8687d5884241dd29 May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-DeleteServersTestJSON-1599111740 May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 14:55:43.611150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 14:55:43.612568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8159266bb76747dc8687d5884241dd29", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8159266bb76747dc8687d5884241dd29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8159266bb76747dc8687d5884241dd29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8159266bb76747dc8687d5884241dd29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:55:43.612568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-DeleteServersTestJSON-1599111740 May 13 14:55:43.612568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 8159266bb76747dc8687d5884241dd29 May 13 14:55:43.612568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-DeleteServersTestJSON-1599111740 May 13 14:55:43.612568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-DeleteServersTestJSON-1599111740-project May 13 14:55:43.612568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 14:55:43.612568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 14:55:43.612568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 461f929b4237427791b49ec3cb465091 May 13 14:55:43.612568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-DeleteServersTestJSON-1599111740-project May 13 14:55:43.612568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 14:55:43.612568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:43.612568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '1542a35b-8d51-4329-89e1-e68453edcb61'} May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:55:43.613303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. May 13 14:55:43.614338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:55:43.615290 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-82ea4ce6-9a41-4bea-bc00-4ae1e4901e49 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] Returning 404 to user: Instance 1542a35b-8d51-4329-89e1-e68453edcb61 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:55:43.615290 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-82ea4ce6-9a41-4bea-bc00-4ae1e4901e49 tempest-DeleteServersTestJSON-1599111740 tempest-DeleteServersTestJSON-1599111740-project] 10.222.0.99 "GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61" status: 404 len: 111 microversion: 2.1 time: 0.030041 May 13 14:55:43.615290 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 140/250] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:43 2022] GET /compute/v2.1/servers/1542a35b-8d51-4329-89e1-e68453edcb61 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:55:44.097368 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1e4e723e-f9ef-46e8-9a1c-a2e27a6c7492 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:44.098104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1e4e723e-f9ef-46e8-9a1c-a2e27a6c7492 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:44.105776 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1e4e723e-f9ef-46e8-9a1c-a2e27a6c7492 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:44.106297 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1e4e723e-f9ef-46e8-9a1c-a2e27a6c7492 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:44.107518 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1e4e723e-f9ef-46e8-9a1c-a2e27a6c7492 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:44.108324 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1e4e723e-f9ef-46e8-9a1c-a2e27a6c7492 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:44.250526 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1e4e723e-f9ef-46e8-9a1c-a2e27a6c7492 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:44.259164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1e4e723e-f9ef-46e8-9a1c-a2e27a6c7492 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.168078 May 13 14:55:44.259945 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 111/251] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:44 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:45.278627 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-1bce4143-02bd-4234-b2ca-21ca1783087e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:45.279288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-1bce4143-02bd-4234-b2ca-21ca1783087e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:45.286616 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1bce4143-02bd-4234-b2ca-21ca1783087e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:45.287054 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1bce4143-02bd-4234-b2ca-21ca1783087e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:45.287817 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1bce4143-02bd-4234-b2ca-21ca1783087e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:45.288294 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1bce4143-02bd-4234-b2ca-21ca1783087e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:45.333399 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-44adece0-2bb2-4d4c-af0a-c8d4de4dd7f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1857780299", "imageRef": "eac0bc7b-d963-4624-aba3-a81fd1bf324c", "flavorRef": "452", "networks": [{"uuid": "e6c5c24c-443e-4c25-9cea-d7f886f2243c"}]}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:55:45.394383 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.network.neutron [None req-44adece0-2bb2-4d4c-af0a-c8d4de4dd7f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] validate_networks() for [('e6c5c24c-443e-4c25-9cea-d7f886f2243c', None, None, None, None, None)] {{(pid=117296) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:55:45.502520 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-1bce4143-02bd-4234-b2ca-21ca1783087e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:45.512857 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-1bce4143-02bd-4234-b2ca-21ca1783087e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.239460 May 13 14:55:45.514213 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 141/252] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:45 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:45.807809 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-44adece0-2bb2-4d4c-af0a-c8d4de4dd7f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Flavor limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:55:45.808292 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-44adece0-2bb2-4d4c-af0a-c8d4de4dd7f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Image limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:55:45.808766 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-44adece0-2bb2-4d4c-af0a-c8d4de4dd7f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Flavor pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:55:45.809199 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-44adece0-2bb2-4d4c-af0a-c8d4de4dd7f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Image pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:55:45.809612 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-44adece0-2bb2-4d4c-af0a-c8d4de4dd7f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:55:45.820021 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-44adece0-2bb2-4d4c-af0a-c8d4de4dd7f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:45.820458 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-44adece0-2bb2-4d4c-af0a-c8d4de4dd7f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:45.821271 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-44adece0-2bb2-4d4c-af0a-c8d4de4dd7f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:45.821721 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-44adece0-2bb2-4d4c-af0a-c8d4de4dd7f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:45.839325 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-44adece0-2bb2-4d4c-af0a-c8d4de4dd7f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Getting quotas for project 96f1f8287c8c4c0da430dc5daef01813. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:55:45.843455 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-44adece0-2bb2-4d4c-af0a-c8d4de4dd7f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Getting quotas for user d8b43419aba7485989facb2d0ed8f1aa and project 96f1f8287c8c4c0da430dc5daef01813. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:55:45.854700 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-44adece0-2bb2-4d4c-af0a-c8d4de4dd7f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Going to run 1 instances... {{(pid=117296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:55:45.856988 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-44adece0-2bb2-4d4c-af0a-c8d4de4dd7f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac0bc7b-d963-4624-aba3-a81fd1bf324c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:55:45.911455 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-44adece0-2bb2-4d4c-af0a-c8d4de4dd7f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581727 May 13 14:55:45.912099 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 112/253] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 14:55:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:55:45.922493 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-a06c1617-b4db-40b2-b0ba-6e9bcffb4c8c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:45.923134 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-a06c1617-b4db-40b2-b0ba-6e9bcffb4c8c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:46.222801 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-a06c1617-b4db-40b2-b0ba-6e9bcffb4c8c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:46.230100 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-a06c1617-b4db-40b2-b0ba-6e9bcffb4c8c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286" status: 200 len: 1214 microversion: 2.1 time: 0.311560 May 13 14:55:46.230651 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 142/254] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:45 2022] GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286 => generated 1214 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:46.530409 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f66ffe0e-88f3-42e9-8ea3-37161485d510 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:46.531063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f66ffe0e-88f3-42e9-8ea3-37161485d510 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:46.538728 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f66ffe0e-88f3-42e9-8ea3-37161485d510 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:46.539182 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f66ffe0e-88f3-42e9-8ea3-37161485d510 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:46.539991 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f66ffe0e-88f3-42e9-8ea3-37161485d510 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:46.540430 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f66ffe0e-88f3-42e9-8ea3-37161485d510 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:46.668182 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f66ffe0e-88f3-42e9-8ea3-37161485d510 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:46.678786 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f66ffe0e-88f3-42e9-8ea3-37161485d510 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.151990 May 13 14:55:46.679516 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 113/255] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:46 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:47.246558 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-35e4a9f3-934d-4faa-9ccb-026734a29359 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:47.247201 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-35e4a9f3-934d-4faa-9ccb-026734a29359 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:47.253909 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-35e4a9f3-934d-4faa-9ccb-026734a29359 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:47.254520 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-35e4a9f3-934d-4faa-9ccb-026734a29359 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:47.255487 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-35e4a9f3-934d-4faa-9ccb-026734a29359 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:47.255912 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-35e4a9f3-934d-4faa-9ccb-026734a29359 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:47.317804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-35e4a9f3-934d-4faa-9ccb-026734a29359 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:47.325386 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-35e4a9f3-934d-4faa-9ccb-026734a29359 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286" status: 200 len: 1272 microversion: 2.1 time: 0.082645 May 13 14:55:47.326197 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 143/256] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:47 2022] GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286 => generated 1272 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:47.675784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8642024a-ac5f-45a0-94c2-82b479adf053 tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] Calling method '.version_select at 0x7fcf4831d9d0>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:47.699650 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c57bb28d-93e8-4bff-85ad-3308ef753942 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:47.701066 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c57bb28d-93e8-4bff-85ad-3308ef753942 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:47.707643 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c57bb28d-93e8-4bff-85ad-3308ef753942 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:47.708652 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c57bb28d-93e8-4bff-85ad-3308ef753942 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:47.708978 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c57bb28d-93e8-4bff-85ad-3308ef753942 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:47.709561 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c57bb28d-93e8-4bff-85ad-3308ef753942 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:47.722959 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8642024a-ac5f-45a0-94c2-82b479adf053 tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/1adba77d-c94a-4fd7-9237-843914c6aeca" status: 200 len: 350 microversion: 2.1 time: 0.051889 May 13 14:55:47.729802 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 114/257] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 14:55:47 2022] GET /compute/v2.1/os-volumes/1adba77d-c94a-4fd7-9237-843914c6aeca => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:55:47.858729 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c57bb28d-93e8-4bff-85ad-3308ef753942 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:47.867822 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c57bb28d-93e8-4bff-85ad-3308ef753942 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.174156 May 13 14:55:47.868702 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 144/258] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:47 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:48.347978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e9391c06-d7e6-4387-98b0-48d67e0a1bbb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:48.348542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-e9391c06-d7e6-4387-98b0-48d67e0a1bbb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:48.356122 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e9391c06-d7e6-4387-98b0-48d67e0a1bbb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:48.356573 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e9391c06-d7e6-4387-98b0-48d67e0a1bbb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:48.357592 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e9391c06-d7e6-4387-98b0-48d67e0a1bbb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:48.358023 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e9391c06-d7e6-4387-98b0-48d67e0a1bbb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:48.492309 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e9391c06-d7e6-4387-98b0-48d67e0a1bbb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:48.499710 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e9391c06-d7e6-4387-98b0-48d67e0a1bbb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286" status: 200 len: 1314 microversion: 2.1 time: 0.155777 May 13 14:55:48.500312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 115/259] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:48 2022] GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:48.653048 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-7262438f-6b37-4605-bf8d-0b722df58cd1 req-33eb2697-ba02-4820-8431-262cf92c75cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a656660e-7e49-465e-b8c5-cad995416286", "tag": "70e33b27-e2e1-4004-ae62-002e0d1a4972"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:55:48.662512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-7262438f-6b37-4605-bf8d-0b722df58cd1 req-33eb2697-ba02-4820-8431-262cf92c75cf service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:48.662965 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-7262438f-6b37-4605-bf8d-0b722df58cd1 req-33eb2697-ba02-4820-8431-262cf92c75cf service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:48.676205 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-7262438f-6b37-4605-bf8d-0b722df58cd1 req-33eb2697-ba02-4820-8431-262cf92c75cf service nova] Creating event network-changed:70e33b27-e2e1-4004-ae62-002e0d1a4972 for instance a656660e-7e49-465e-b8c5-cad995416286 on hv-cinder-83090 May 13 14:55:48.681378 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-7262438f-6b37-4605-bf8d-0b722df58cd1 req-33eb2697-ba02-4820-8431-262cf92c75cf service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032032 May 13 14:55:48.681967 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 145/260] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:55:48.885932 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-aea287f4-62e5-4819-9ac3-167e8cd00213 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:48.886546 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-aea287f4-62e5-4819-9ac3-167e8cd00213 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:48.893573 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-aea287f4-62e5-4819-9ac3-167e8cd00213 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:48.894022 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-aea287f4-62e5-4819-9ac3-167e8cd00213 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:48.894799 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-aea287f4-62e5-4819-9ac3-167e8cd00213 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:48.895230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-aea287f4-62e5-4819-9ac3-167e8cd00213 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:49.029207 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-aea287f4-62e5-4819-9ac3-167e8cd00213 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:49.037785 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-aea287f4-62e5-4819-9ac3-167e8cd00213 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.154985 May 13 14:55:49.038345 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 116/261] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:48 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:49.518411 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-0db57abd-1808-437a-aacd-a726fe502804 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:49.519224 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-0db57abd-1808-437a-aacd-a726fe502804 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:49.525466 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0db57abd-1808-437a-aacd-a726fe502804 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:49.525910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0db57abd-1808-437a-aacd-a726fe502804 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:49.526670 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0db57abd-1808-437a-aacd-a726fe502804 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:49.527110 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0db57abd-1808-437a-aacd-a726fe502804 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:49.660483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-0db57abd-1808-437a-aacd-a726fe502804 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:49.668289 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-0db57abd-1808-437a-aacd-a726fe502804 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286" status: 200 len: 1314 microversion: 2.1 time: 0.155037 May 13 14:55:49.668853 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 146/262] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:49 2022] GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:50.058282 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-11c67c29-0fc1-42be-8bb4-3ddc56d2d4b1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:50.059492 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-11c67c29-0fc1-42be-8bb4-3ddc56d2d4b1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:50.073478 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-11c67c29-0fc1-42be-8bb4-3ddc56d2d4b1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:50.073644 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-11c67c29-0fc1-42be-8bb4-3ddc56d2d4b1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:50.074946 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-11c67c29-0fc1-42be-8bb4-3ddc56d2d4b1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:50.075670 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-11c67c29-0fc1-42be-8bb4-3ddc56d2d4b1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:50.126564 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-308d380d-48d1-4d84-bb6e-f32ede88a21c tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] Calling method '.version_select at 0x7fcf483490d0>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:50.176663 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-308d380d-48d1-4d84-bb6e-f32ede88a21c tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/ac77f2f8-4b02-4928-bbb7-05af0263f508" status: 200 len: 350 microversion: 2.1 time: 0.054441 May 13 14:55:50.177391 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 147/263] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 14:55:50 2022] GET /compute/v2.1/os-volumes/ac77f2f8-4b02-4928-bbb7-05af0263f508 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:55:50.217308 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-11c67c29-0fc1-42be-8bb4-3ddc56d2d4b1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:50.225024 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-11c67c29-0fc1-42be-8bb4-3ddc56d2d4b1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.173406 May 13 14:55:50.225608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 117/264] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:50 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:50.685430 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4614fc1e-e293-41b7-98df-1844970f1a1c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:50.686186 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4614fc1e-e293-41b7-98df-1844970f1a1c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:50.692843 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4614fc1e-e293-41b7-98df-1844970f1a1c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:50.693314 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4614fc1e-e293-41b7-98df-1844970f1a1c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:50.694074 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4614fc1e-e293-41b7-98df-1844970f1a1c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:50.694498 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4614fc1e-e293-41b7-98df-1844970f1a1c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:50.823017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4614fc1e-e293-41b7-98df-1844970f1a1c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:50.831216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4614fc1e-e293-41b7-98df-1844970f1a1c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286" status: 200 len: 1314 microversion: 2.1 time: 0.149629 May 13 14:55:50.831797 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 148/265] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:50 2022] GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:51.245881 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6773e040-4517-449e-a150-3446a05dc8c0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:51.246456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6773e040-4517-449e-a150-3446a05dc8c0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:51.254934 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6773e040-4517-449e-a150-3446a05dc8c0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:51.255384 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6773e040-4517-449e-a150-3446a05dc8c0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:51.256205 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6773e040-4517-449e-a150-3446a05dc8c0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:51.256635 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6773e040-4517-449e-a150-3446a05dc8c0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:51.398042 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6773e040-4517-449e-a150-3446a05dc8c0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:51.407749 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6773e040-4517-449e-a150-3446a05dc8c0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.168170 May 13 14:55:51.408358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 118/266] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:51 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:51.494655 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f33c211e-3227-4d42-9a0d-f16e47890905 tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] Calling method '.version_select at 0x7fcf482d9820>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:51.555146 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f33c211e-3227-4d42-9a0d-f16e47890905 tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/ab014d23-d0d2-4762-b696-c3105c722597" status: 200 len: 350 microversion: 2.1 time: 0.064139 May 13 14:55:51.555752 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 149/267] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 14:55:51 2022] GET /compute/v2.1/os-volumes/ab014d23-d0d2-4762-b696-c3105c722597 => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:55:51.570423 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c44c953e-0825-4c76-8fb5-4e8a0b163e29 tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] Calling method '.version_select at 0x7fcf4831dd30>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:51.654359 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c44c953e-0825-4c76-8fb5-4e8a0b163e29 tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] 10.222.0.99 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.089845 May 13 14:55:51.655227 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 119/268] 10.222.0.99 () {58 vars in 1133 bytes} [Fri May 13 14:55:51 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:51.667332 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-b7f16acf-eb32-45c0-8001-3234a17f0875 tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] Calling method '.version_select at 0x7fcf482d94c0>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:51.748902 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-b7f16acf-eb32-45c0-8001-3234a17f0875 tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] 10.222.0.99 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.084901 May 13 14:55:51.749492 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 150/269] 10.222.0.99 () {58 vars in 1148 bytes} [Fri May 13 14:55:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:55:51.764837 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-d88bc595-f50e-4322-b43f-e51a72df0683 tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] Calling method '.version_select at 0x7fcf48328af0>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:51.845244 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-d88bc595-f50e-4322-b43f-e51a72df0683 tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] 10.222.0.99 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.086850 May 13 14:55:51.845918 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 120/270] 10.222.0.99 () {58 vars in 1133 bytes} [Fri May 13 14:55:51 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:51.848569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d3bce2f4-6577-45eb-a9a2-c3c545a0a66c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:51.849179 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d3bce2f4-6577-45eb-a9a2-c3c545a0a66c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:51.856486 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d3bce2f4-6577-45eb-a9a2-c3c545a0a66c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:51.856929 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d3bce2f4-6577-45eb-a9a2-c3c545a0a66c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:51.857061 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-2c31335c-e4b7-4c2d-9dd3-c79e7792944c tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] Calling method '.version_select at 0x7fcf4832b0d0>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:51.857705 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d3bce2f4-6577-45eb-a9a2-c3c545a0a66c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:51.858136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d3bce2f4-6577-45eb-a9a2-c3c545a0a66c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:51.940344 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-2c31335c-e4b7-4c2d-9dd3-c79e7792944c tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] 10.222.0.99 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.086901 May 13 14:55:51.940927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 121/271] 10.222.0.99 () {58 vars in 1166 bytes} [Fri May 13 14:55:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:55:51.952605 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f4c71b9a-e26e-4f98-a6bf-34b2957c0cd4 tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] Calling method '.version_select at 0x7fcf48328ca0>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:52.003185 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d3bce2f4-6577-45eb-a9a2-c3c545a0a66c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:52.010856 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d3bce2f4-6577-45eb-a9a2-c3c545a0a66c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286" status: 200 len: 1314 microversion: 2.1 time: 0.166253 May 13 14:55:52.011415 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 151/272] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:51 2022] GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:55:52.047945 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f4c71b9a-e26e-4f98-a6bf-34b2957c0cd4 tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.099252 May 13 14:55:52.048526 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 122/273] 10.222.0.99 () {58 vars in 1169 bytes} [Fri May 13 14:55:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:55:52.060392 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-577f50bb-196b-465b-85df-f5fcef67b372 tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] Calling method '.version_select at 0x7fcf482d9af0>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:52.143090 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-577f50bb-196b-465b-85df-f5fcef67b372 tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.086371 May 13 14:55:52.143670 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 152/274] 10.222.0.99 () {58 vars in 1154 bytes} [Fri May 13 14:55:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:52.155356 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-fcc5afb8-5066-40c1-ae7b-2f36b2dc987b tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] Calling method '.version_select at 0x7fcf4832be50>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:52.240951 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-fcc5afb8-5066-40c1-ae7b-2f36b2dc987b tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089814 May 13 14:55:52.241529 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 123/275] 10.222.0.99 () {58 vars in 1187 bytes} [Fri May 13 14:55:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:55:52.253167 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ebe0c942-f522-4b0b-8456-188fa004df39 tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] Calling method '.version_select at 0x7fcf48349550>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:52.334484 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ebe0c942-f522-4b0b-8456-188fa004df39 tempest-VolumesTestJSON-19316858 tempest-VolumesTestJSON-19316858-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.084946 May 13 14:55:52.335109 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 153/276] 10.222.0.99 () {58 vars in 1154 bytes} [Fri May 13 14:55:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:52.425583 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-defb9ddf-148d-42d0-aec3-2b05eb0ab63d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:52.426780 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-defb9ddf-148d-42d0-aec3-2b05eb0ab63d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:52.434742 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-defb9ddf-148d-42d0-aec3-2b05eb0ab63d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:52.435358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-defb9ddf-148d-42d0-aec3-2b05eb0ab63d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:52.436640 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-defb9ddf-148d-42d0-aec3-2b05eb0ab63d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:52.437242 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-defb9ddf-148d-42d0-aec3-2b05eb0ab63d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:52.643310 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-defb9ddf-148d-42d0-aec3-2b05eb0ab63d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:52.652295 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-defb9ddf-148d-42d0-aec3-2b05eb0ab63d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.230681 May 13 14:55:52.652906 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 124/277] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:52 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:53.027158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ecc878cd-92da-4294-a080-b79e34911d74 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:53.027755 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ecc878cd-92da-4294-a080-b79e34911d74 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:53.034772 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ecc878cd-92da-4294-a080-b79e34911d74 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:53.035393 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ecc878cd-92da-4294-a080-b79e34911d74 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:53.036478 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ecc878cd-92da-4294-a080-b79e34911d74 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:53.036946 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ecc878cd-92da-4294-a080-b79e34911d74 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:53.166351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ecc878cd-92da-4294-a080-b79e34911d74 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:53.173815 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ecc878cd-92da-4294-a080-b79e34911d74 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286" status: 200 len: 1314 microversion: 2.1 time: 0.150883 May 13 14:55:53.174391 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 154/278] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:53 2022] GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:53.669440 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a4a6fa16-a06e-4618-ad5e-fd084e945ce9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:53.670010 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a4a6fa16-a06e-4618-ad5e-fd084e945ce9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:53.676778 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a4a6fa16-a06e-4618-ad5e-fd084e945ce9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:53.677227 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a4a6fa16-a06e-4618-ad5e-fd084e945ce9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:53.677998 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a4a6fa16-a06e-4618-ad5e-fd084e945ce9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:53.678430 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a4a6fa16-a06e-4618-ad5e-fd084e945ce9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:53.825827 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-a4a6fa16-a06e-4618-ad5e-fd084e945ce9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:53.835470 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a4a6fa16-a06e-4618-ad5e-fd084e945ce9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.169842 May 13 14:55:53.836398 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 125/279] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:53 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:54.191286 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-a733a824-679b-4aac-8aa0-967db2800922 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:54.191837 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-a733a824-679b-4aac-8aa0-967db2800922 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:54.198470 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a733a824-679b-4aac-8aa0-967db2800922 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:54.198892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a733a824-679b-4aac-8aa0-967db2800922 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:54.199668 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a733a824-679b-4aac-8aa0-967db2800922 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:54.200131 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a733a824-679b-4aac-8aa0-967db2800922 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:54.348886 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-a733a824-679b-4aac-8aa0-967db2800922 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:54.357333 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-a733a824-679b-4aac-8aa0-967db2800922 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286" status: 200 len: 1314 microversion: 2.1 time: 0.170045 May 13 14:55:54.357907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 155/280] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:54 2022] GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:54.857956 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-720caf1f-2587-4c2d-821b-7b6f210ba7d5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:54.859440 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-720caf1f-2587-4c2d-821b-7b6f210ba7d5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:54.866218 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-720caf1f-2587-4c2d-821b-7b6f210ba7d5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:54.866642 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-720caf1f-2587-4c2d-821b-7b6f210ba7d5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:54.867421 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-720caf1f-2587-4c2d-821b-7b6f210ba7d5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:54.867855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-720caf1f-2587-4c2d-821b-7b6f210ba7d5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:55.013020 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-720caf1f-2587-4c2d-821b-7b6f210ba7d5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:55.022356 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-720caf1f-2587-4c2d-821b-7b6f210ba7d5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.172348 May 13 14:55:55.023260 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 126/281] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:54 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:55.373570 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-10dd26f1-2b4b-4a23-88d7-999a5722dc0d tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:55.374218 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-10dd26f1-2b4b-4a23-88d7-999a5722dc0d tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:55.380503 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-10dd26f1-2b4b-4a23-88d7-999a5722dc0d tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:55.380949 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-10dd26f1-2b4b-4a23-88d7-999a5722dc0d tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:55.381803 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-10dd26f1-2b4b-4a23-88d7-999a5722dc0d tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:55.382238 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-10dd26f1-2b4b-4a23-88d7-999a5722dc0d tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:55.489996 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-16fd0ebe-4cc0-4515-956f-f00f5a83b872 req-a33d67a4-a1de-4dd3-bac2-4eb182178b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a656660e-7e49-465e-b8c5-cad995416286", "name": "network-vif-plugged", "status": "completed", "tag": "70e33b27-e2e1-4004-ae62-002e0d1a4972"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:55:55.498224 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-16fd0ebe-4cc0-4515-956f-f00f5a83b872 req-a33d67a4-a1de-4dd3-bac2-4eb182178b98 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:55.498968 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-16fd0ebe-4cc0-4515-956f-f00f5a83b872 req-a33d67a4-a1de-4dd3-bac2-4eb182178b98 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:55.518265 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-16fd0ebe-4cc0-4515-956f-f00f5a83b872 req-a33d67a4-a1de-4dd3-bac2-4eb182178b98 service nova] Creating event network-vif-plugged:70e33b27-e2e1-4004-ae62-002e0d1a4972 for instance a656660e-7e49-465e-b8c5-cad995416286 on hv-cinder-83090 May 13 14:55:55.523575 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-16fd0ebe-4cc0-4515-956f-f00f5a83b872 req-a33d67a4-a1de-4dd3-bac2-4eb182178b98 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037172 May 13 14:55:55.524685 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 127/282] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:55:55.548594 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-10dd26f1-2b4b-4a23-88d7-999a5722dc0d tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:55.555958 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-10dd26f1-2b4b-4a23-88d7-999a5722dc0d tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286" status: 200 len: 1314 microversion: 2.1 time: 0.186116 May 13 14:55:55.556485 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 156/283] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:55 2022] GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:56.041215 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-0421fd0c-2cff-485c-9228-53137bb23e24 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:56.041910 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-0421fd0c-2cff-485c-9228-53137bb23e24 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:56.048419 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0421fd0c-2cff-485c-9228-53137bb23e24 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:56.048868 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0421fd0c-2cff-485c-9228-53137bb23e24 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:56.049643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0421fd0c-2cff-485c-9228-53137bb23e24 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:56.050282 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0421fd0c-2cff-485c-9228-53137bb23e24 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:56.184500 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-0421fd0c-2cff-485c-9228-53137bb23e24 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:56.192105 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-0421fd0c-2cff-485c-9228-53137bb23e24 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.155554 May 13 14:55:56.192690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 128/284] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:56 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:56.573616 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-eb06631e-f950-4596-9993-6b85faab90dd tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:56.574210 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-eb06631e-f950-4596-9993-6b85faab90dd tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:56.580328 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-eb06631e-f950-4596-9993-6b85faab90dd tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:56.580762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-eb06631e-f950-4596-9993-6b85faab90dd tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:56.581524 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-eb06631e-f950-4596-9993-6b85faab90dd tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:56.581952 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-eb06631e-f950-4596-9993-6b85faab90dd tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:56.730917 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-eb06631e-f950-4596-9993-6b85faab90dd tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:56.738720 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-eb06631e-f950-4596-9993-6b85faab90dd tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286" status: 200 len: 1314 microversion: 2.1 time: 0.168951 May 13 14:55:56.739505 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 157/285] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:56 2022] GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:57.208553 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-747bacc6-87f4-4dd3-bf4e-1d6638527124 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:57.209001 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-747bacc6-87f4-4dd3-bf4e-1d6638527124 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:57.215213 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-747bacc6-87f4-4dd3-bf4e-1d6638527124 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:57.215647 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-747bacc6-87f4-4dd3-bf4e-1d6638527124 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:57.216435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-747bacc6-87f4-4dd3-bf4e-1d6638527124 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:57.216864 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-747bacc6-87f4-4dd3-bf4e-1d6638527124 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:57.623339 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-747bacc6-87f4-4dd3-bf4e-1d6638527124 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:57.636313 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-747bacc6-87f4-4dd3-bf4e-1d6638527124 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.431564 May 13 14:55:57.637106 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 129/286] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:57 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:57.756974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-fdcee33f-ee0a-441f-b924-0f17d87f1dc8 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:57.757585 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-fdcee33f-ee0a-441f-b924-0f17d87f1dc8 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:57.769745 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fdcee33f-ee0a-441f-b924-0f17d87f1dc8 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:57.770219 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fdcee33f-ee0a-441f-b924-0f17d87f1dc8 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:57.772002 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fdcee33f-ee0a-441f-b924-0f17d87f1dc8 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:57.772792 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fdcee33f-ee0a-441f-b924-0f17d87f1dc8 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:58.016247 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-fdcee33f-ee0a-441f-b924-0f17d87f1dc8 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:58.024498 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-fdcee33f-ee0a-441f-b924-0f17d87f1dc8 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286" status: 200 len: 1497 microversion: 2.1 time: 0.271461 May 13 14:55:58.046625 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 158/287] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:57 2022] GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286 => generated 1497 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:58.583973 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-0acb467d-2229-41f7-9db9-1cbdc85eb534 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:58.584440 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-0acb467d-2229-41f7-9db9-1cbdc85eb534 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:58.591090 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0acb467d-2229-41f7-9db9-1cbdc85eb534 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:58.591564 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0acb467d-2229-41f7-9db9-1cbdc85eb534 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:58.592376 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0acb467d-2229-41f7-9db9-1cbdc85eb534 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:58.592839 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0acb467d-2229-41f7-9db9-1cbdc85eb534 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:58.620996 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-0acb467d-2229-41f7-9db9-1cbdc85eb534 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] Going to try to terminate instance {{(pid=117296) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:55:58.653619 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-932c3b78-3e22-45f2-9198-80c28a9ad093 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:58.654260 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-932c3b78-3e22-45f2-9198-80c28a9ad093 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:58.660728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-932c3b78-3e22-45f2-9198-80c28a9ad093 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:58.661234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-932c3b78-3e22-45f2-9198-80c28a9ad093 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:58.662009 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-932c3b78-3e22-45f2-9198-80c28a9ad093 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:58.662590 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-932c3b78-3e22-45f2-9198-80c28a9ad093 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:58.725686 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-0acb467d-2229-41f7-9db9-1cbdc85eb534 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286" status: 204 len: 0 microversion: 2.1 time: 0.145066 May 13 14:55:58.726520 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 130/288] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 14:55:58 2022] DELETE /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:55:58.738029 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7629f5ec-cbe5-499a-a327-b1f2d9cd099e tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:58.738716 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7629f5ec-cbe5-499a-a327-b1f2d9cd099e tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:58.745636 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7629f5ec-cbe5-499a-a327-b1f2d9cd099e tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:58.746054 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7629f5ec-cbe5-499a-a327-b1f2d9cd099e tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:58.746979 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7629f5ec-cbe5-499a-a327-b1f2d9cd099e tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:58.747401 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7629f5ec-cbe5-499a-a327-b1f2d9cd099e tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:58.889953 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-932c3b78-3e22-45f2-9198-80c28a9ad093 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:58.897976 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-932c3b78-3e22-45f2-9198-80c28a9ad093 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.248303 May 13 14:55:58.898544 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 159/289] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:58 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:58.956948 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7629f5ec-cbe5-499a-a327-b1f2d9cd099e tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:55:58.965137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7629f5ec-cbe5-499a-a327-b1f2d9cd099e tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286" status: 200 len: 1503 microversion: 2.1 time: 0.233102 May 13 14:55:58.965942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 131/290] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:58 2022] GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286 => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:55:59.915006 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-407f60f9-0f91-4e47-a948-abecd3a8e5af tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:59.915522 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-407f60f9-0f91-4e47-a948-abecd3a8e5af tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:59.923171 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-407f60f9-0f91-4e47-a948-abecd3a8e5af tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:59.923686 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-407f60f9-0f91-4e47-a948-abecd3a8e5af tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:59.924510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-407f60f9-0f91-4e47-a948-abecd3a8e5af tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:59.924934 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-407f60f9-0f91-4e47-a948-abecd3a8e5af tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:59.983459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-4c4b2e98-ff62-4f22-ae1d-228911b36ee1 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:55:59.984345 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-4c4b2e98-ff62-4f22-ae1d-228911b36ee1 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:55:59.992489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4c4b2e98-ff62-4f22-ae1d-228911b36ee1 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:59.993082 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4c4b2e98-ff62-4f22-ae1d-228911b36ee1 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:55:59.993860 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4c4b2e98-ff62-4f22-ae1d-228911b36ee1 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:55:59.994368 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4c4b2e98-ff62-4f22-ae1d-228911b36ee1 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:00.306036 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-407f60f9-0f91-4e47-a948-abecd3a8e5af tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:00.314075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-407f60f9-0f91-4e47-a948-abecd3a8e5af tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.403044 May 13 14:56:00.314683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 160/291] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:59 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:00.379141 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-4c4b2e98-ff62-4f22-ae1d-228911b36ee1 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:00.387145 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-4c4b2e98-ff62-4f22-ae1d-228911b36ee1 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286" status: 200 len: 1503 microversion: 2.1 time: 0.407835 May 13 14:56:00.387855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 132/292] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:55:59 2022] GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286 => generated 1503 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:56:01.331475 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3c265ec0-7298-43a5-a5c8-04161b1bebee tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:01.332656 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3c265ec0-7298-43a5-a5c8-04161b1bebee tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:01.339402 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3c265ec0-7298-43a5-a5c8-04161b1bebee tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:01.340151 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3c265ec0-7298-43a5-a5c8-04161b1bebee tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:01.341174 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3c265ec0-7298-43a5-a5c8-04161b1bebee tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:01.341625 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3c265ec0-7298-43a5-a5c8-04161b1bebee tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:01.407264 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cd67719a-4879-4110-a622-716ec1e30aed tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:01.408529 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-cd67719a-4879-4110-a622-716ec1e30aed tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:01.415794 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cd67719a-4879-4110-a622-716ec1e30aed tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:01.416494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cd67719a-4879-4110-a622-716ec1e30aed tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:01.417561 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cd67719a-4879-4110-a622-716ec1e30aed tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:01.418157 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cd67719a-4879-4110-a622-716ec1e30aed tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:01.517670 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-cd67719a-4879-4110-a622-716ec1e30aed tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:01.549350 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-cd67719a-4879-4110-a622-716ec1e30aed tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286" status: 200 len: 1461 microversion: 2.1 time: 0.146691 May 13 14:56:01.552031 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 133/293] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:01 2022] GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286 => generated 1461 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:01.556959 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-21ab8cdf-9256-4766-b2b9-1e90a880c160 req-a88df8a6-e8dc-4bd8-9be9-a13efa19d8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a656660e-7e49-465e-b8c5-cad995416286", "name": "network-vif-deleted", "tag": "70e33b27-e2e1-4004-ae62-002e0d1a4972"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:56:01.568296 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3c265ec0-7298-43a5-a5c8-04161b1bebee tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:01.578971 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3c265ec0-7298-43a5-a5c8-04161b1bebee tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.251705 May 13 14:56:01.584492 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-21ab8cdf-9256-4766-b2b9-1e90a880c160 req-a88df8a6-e8dc-4bd8-9be9-a13efa19d8be service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:01.585212 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 161/294] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:01 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:01.586741 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-21ab8cdf-9256-4766-b2b9-1e90a880c160 req-a88df8a6-e8dc-4bd8-9be9-a13efa19d8be service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:01.602859 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-21ab8cdf-9256-4766-b2b9-1e90a880c160 req-a88df8a6-e8dc-4bd8-9be9-a13efa19d8be service nova] Creating event network-vif-deleted:70e33b27-e2e1-4004-ae62-002e0d1a4972 for instance a656660e-7e49-465e-b8c5-cad995416286 on hv-cinder-83090 May 13 14:56:01.608624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-21ab8cdf-9256-4766-b2b9-1e90a880c160 req-a88df8a6-e8dc-4bd8-9be9-a13efa19d8be service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055113 May 13 14:56:01.609624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 134/295] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:56:02.567139 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-00b19d2c-be76-44cc-90ab-255aa0cc85fb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:02.569122 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-00b19d2c-be76-44cc-90ab-255aa0cc85fb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: a656660e-7e49-465e-b8c5-cad995416286] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:02.577027 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-00b19d2c-be76-44cc-90ab-255aa0cc85fb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:02.577574 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-00b19d2c-be76-44cc-90ab-255aa0cc85fb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:02.578374 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-00b19d2c-be76-44cc-90ab-255aa0cc85fb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:02.579481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-00b19d2c-be76-44cc-90ab-255aa0cc85fb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:02.593179 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-00b19d2c-be76-44cc-90ab-255aa0cc85fb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] HTTP exception thrown: Instance a656660e-7e49-465e-b8c5-cad995416286 could not be found. May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-00b19d2c-be76-44cc-90ab-255aa0cc85fb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Request method failure captured: May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286 HTTP/1.1 May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnFumlfg7ZOLqdiTBtkNsABGNSulbFiUpjnC1h0CNKUEUTbMHPZ14t6P9nGfKxnEygtoyjr3i0zoLdR6LJ3-wQwY_A3u74_jc65l09CF9eOxCZ_XoJw5q1o4g6XxhynGycYZSZR2G4SKZhtGzt7pl4bJjFzaUb9-H3OXlg3XbubByIw May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 96f1f8287c8c4c0da430dc5daef01813 May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-VolumesActionsTest-473642710 May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 14:56:02.597708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 14:56:02.599220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_96f1f8287c8c4c0da430dc5daef01813", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/96f1f8287c8c4c0da430dc5daef01813"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/96f1f8287c8c4c0da430dc5daef01813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/96f1f8287c8c4c0da430dc5daef01813"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:56:02.599220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-VolumesActionsTest-473642710 May 13 14:56:02.599220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 96f1f8287c8c4c0da430dc5daef01813 May 13 14:56:02.599220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-VolumesActionsTest-473642710 May 13 14:56:02.599220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-VolumesActionsTest-473642710-project May 13 14:56:02.599220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 14:56:02.599220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 14:56:02.599220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: d8b43419aba7485989facb2d0ed8f1aa May 13 14:56:02.599220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-VolumesActionsTest-473642710-project May 13 14:56:02.599220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 14:56:02.599220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance a656660e-7e49-465e-b8c5-cad995416286 could not be found. May 13 14:56:02.599220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': 'a656660e-7e49-465e-b8c5-cad995416286'} May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a656660e-7e49-465e-b8c5-cad995416286 could not be found. May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:56:02.602910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a656660e-7e49-465e-b8c5-cad995416286 could not be found. May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a656660e-7e49-465e-b8c5-cad995416286 could not be found. May 13 14:56:02.604336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:56:02.605546 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b712ed86-544f-47c7-a7d7-5ca2c807d452 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:02.605546 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b712ed86-544f-47c7-a7d7-5ca2c807d452 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:02.606790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-00b19d2c-be76-44cc-90ab-255aa0cc85fb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Returning 404 to user: Instance a656660e-7e49-465e-b8c5-cad995416286 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:56:02.607803 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-00b19d2c-be76-44cc-90ab-255aa0cc85fb tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286" status: 404 len: 111 microversion: 2.1 time: 0.045250 May 13 14:56:02.608551 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 162/296] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:02 2022] GET /compute/v2.1/servers/a656660e-7e49-465e-b8c5-cad995416286 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:56:02.615231 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b712ed86-544f-47c7-a7d7-5ca2c807d452 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:02.615231 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b712ed86-544f-47c7-a7d7-5ca2c807d452 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:02.615231 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b712ed86-544f-47c7-a7d7-5ca2c807d452 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:02.615231 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b712ed86-544f-47c7-a7d7-5ca2c807d452 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:02.774532 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b712ed86-544f-47c7-a7d7-5ca2c807d452 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:02.781896 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-270f5c22-34e7-4868-bbdd-229db8de51e7 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-92197707", "imageRef": "eac0bc7b-d963-4624-aba3-a81fd1bf324c", "flavorRef": "452", "networks": [{"uuid": "e6c5c24c-443e-4c25-9cea-d7f886f2243c"}]}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:56:02.783586 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b712ed86-544f-47c7-a7d7-5ca2c807d452 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.185838 May 13 14:56:02.794044 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 135/297] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:02 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:56:02.852327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.network.neutron [None req-270f5c22-34e7-4868-bbdd-229db8de51e7 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] validate_networks() for [('e6c5c24c-443e-4c25-9cea-d7f886f2243c', None, None, None, None, None)] {{(pid=117295) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:56:03.234659 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-270f5c22-34e7-4868-bbdd-229db8de51e7 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Flavor limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:56:03.235103 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-270f5c22-34e7-4868-bbdd-229db8de51e7 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Image limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:56:03.235670 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-270f5c22-34e7-4868-bbdd-229db8de51e7 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Flavor pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:56:03.236134 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-270f5c22-34e7-4868-bbdd-229db8de51e7 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Image pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:56:03.236543 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-270f5c22-34e7-4868-bbdd-229db8de51e7 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:56:03.246353 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-270f5c22-34e7-4868-bbdd-229db8de51e7 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:03.246806 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-270f5c22-34e7-4868-bbdd-229db8de51e7 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:03.247608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-270f5c22-34e7-4868-bbdd-229db8de51e7 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:03.248088 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-270f5c22-34e7-4868-bbdd-229db8de51e7 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:03.265536 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-270f5c22-34e7-4868-bbdd-229db8de51e7 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Getting quotas for project 96f1f8287c8c4c0da430dc5daef01813. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:56:03.270050 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-270f5c22-34e7-4868-bbdd-229db8de51e7 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Getting quotas for user d8b43419aba7485989facb2d0ed8f1aa and project 96f1f8287c8c4c0da430dc5daef01813. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:56:03.281366 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-270f5c22-34e7-4868-bbdd-229db8de51e7 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Going to run 1 instances... {{(pid=117295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:56:03.283682 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-270f5c22-34e7-4868-bbdd-229db8de51e7 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac0bc7b-d963-4624-aba3-a81fd1bf324c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:56:03.330564 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-270f5c22-34e7-4868-bbdd-229db8de51e7 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552371 May 13 14:56:03.336109 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 163/298] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 14:56:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 14:56:03.341217 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-82bff25c-b2fe-4349-9a8a-b197de08ee6c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:03.341817 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-82bff25c-b2fe-4349-9a8a-b197de08ee6c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:03.401151 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-82bff25c-b2fe-4349-9a8a-b197de08ee6c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:03.412767 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-82bff25c-b2fe-4349-9a8a-b197de08ee6c tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1212 microversion: 2.1 time: 0.075485 May 13 14:56:03.413338 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 136/299] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:03 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1212 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:03.800907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-28f78ba7-390c-42ee-b181-0b4052afaa60 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:03.801792 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-28f78ba7-390c-42ee-b181-0b4052afaa60 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:03.808320 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-28f78ba7-390c-42ee-b181-0b4052afaa60 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:03.808772 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-28f78ba7-390c-42ee-b181-0b4052afaa60 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:03.809590 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-28f78ba7-390c-42ee-b181-0b4052afaa60 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:03.810000 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-28f78ba7-390c-42ee-b181-0b4052afaa60 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:03.959626 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-28f78ba7-390c-42ee-b181-0b4052afaa60 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:03.968975 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-28f78ba7-390c-42ee-b181-0b4052afaa60 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.172086 May 13 14:56:03.970447 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 164/300] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:03 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:04.429866 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7e2531c2-3d9f-4e4e-ab4f-784e061e9351 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:04.431092 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7e2531c2-3d9f-4e4e-ab4f-784e061e9351 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:04.438423 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7e2531c2-3d9f-4e4e-ab4f-784e061e9351 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:04.439404 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7e2531c2-3d9f-4e4e-ab4f-784e061e9351 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:04.440829 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7e2531c2-3d9f-4e4e-ab4f-784e061e9351 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:04.441348 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7e2531c2-3d9f-4e4e-ab4f-784e061e9351 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:04.537543 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7e2531c2-3d9f-4e4e-ab4f-784e061e9351 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:04.544947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7e2531c2-3d9f-4e4e-ab4f-784e061e9351 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1282 microversion: 2.1 time: 0.118979 May 13 14:56:04.554656 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 137/301] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:04 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1282 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:04.989113 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-7d4e94e9-e526-4ea3-9d7b-41839fd8507f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:04.989478 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-7d4e94e9-e526-4ea3-9d7b-41839fd8507f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:04.997179 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7d4e94e9-e526-4ea3-9d7b-41839fd8507f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:04.997979 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7d4e94e9-e526-4ea3-9d7b-41839fd8507f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:04.998992 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7d4e94e9-e526-4ea3-9d7b-41839fd8507f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:04.999977 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7d4e94e9-e526-4ea3-9d7b-41839fd8507f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:05.146397 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-7d4e94e9-e526-4ea3-9d7b-41839fd8507f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:05.155761 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-7d4e94e9-e526-4ea3-9d7b-41839fd8507f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.171625 May 13 14:56:05.159904 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 165/302] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:04 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:05.561199 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1c8e929d-6f19-495d-8c60-6cbbb998e4b6 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:05.561803 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1c8e929d-6f19-495d-8c60-6cbbb998e4b6 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:05.568571 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1c8e929d-6f19-495d-8c60-6cbbb998e4b6 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:05.569001 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1c8e929d-6f19-495d-8c60-6cbbb998e4b6 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:05.569982 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1c8e929d-6f19-495d-8c60-6cbbb998e4b6 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:05.570415 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1c8e929d-6f19-495d-8c60-6cbbb998e4b6 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:05.727312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1c8e929d-6f19-495d-8c60-6cbbb998e4b6 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:05.735078 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1c8e929d-6f19-495d-8c60-6cbbb998e4b6 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1312 microversion: 2.1 time: 0.177665 May 13 14:56:05.736039 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 138/303] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:05 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:05.794066 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-a6f65d7d-c351-48c3-95ca-e4f268c4ec0c req-7506a75d-8ce7-48fa-b2db-da83bab82ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdaf8813-b010-4bbb-beb4-635a6f2b5f6c", "tag": "1e71d128-7333-4a05-adab-6241a47aa224"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:56:05.802465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-a6f65d7d-c351-48c3-95ca-e4f268c4ec0c req-7506a75d-8ce7-48fa-b2db-da83bab82ec0 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:05.803239 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-a6f65d7d-c351-48c3-95ca-e4f268c4ec0c req-7506a75d-8ce7-48fa-b2db-da83bab82ec0 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:05.816819 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-a6f65d7d-c351-48c3-95ca-e4f268c4ec0c req-7506a75d-8ce7-48fa-b2db-da83bab82ec0 service nova] Creating event network-changed:1e71d128-7333-4a05-adab-6241a47aa224 for instance cdaf8813-b010-4bbb-beb4-635a6f2b5f6c on hv-cinder-83090 May 13 14:56:05.821846 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-a6f65d7d-c351-48c3-95ca-e4f268c4ec0c req-7506a75d-8ce7-48fa-b2db-da83bab82ec0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031392 May 13 14:56:05.822481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 166/304] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:56:06.175113 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-99378e4c-04ec-431c-8ba3-ae2f26954851 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:06.175752 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-99378e4c-04ec-431c-8ba3-ae2f26954851 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:06.182880 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-99378e4c-04ec-431c-8ba3-ae2f26954851 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:06.183330 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-99378e4c-04ec-431c-8ba3-ae2f26954851 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:06.184257 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-99378e4c-04ec-431c-8ba3-ae2f26954851 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:06.184704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-99378e4c-04ec-431c-8ba3-ae2f26954851 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:06.330680 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-99378e4c-04ec-431c-8ba3-ae2f26954851 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:06.340896 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-99378e4c-04ec-431c-8ba3-ae2f26954851 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.170363 May 13 14:56:06.341687 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 139/305] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:06 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:06.753759 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-a5149f94-f686-418a-9256-d834e9efc896 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:06.754474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-a5149f94-f686-418a-9256-d834e9efc896 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:06.761105 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a5149f94-f686-418a-9256-d834e9efc896 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:06.761539 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a5149f94-f686-418a-9256-d834e9efc896 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:06.762303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a5149f94-f686-418a-9256-d834e9efc896 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:06.762726 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a5149f94-f686-418a-9256-d834e9efc896 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:06.896124 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-a5149f94-f686-418a-9256-d834e9efc896 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:06.903597 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-a5149f94-f686-418a-9256-d834e9efc896 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1312 microversion: 2.1 time: 0.154033 May 13 14:56:06.904199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 167/306] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:06 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:07.359278 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b3fe8e47-6fca-41ca-a607-18a5280b7c2b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:07.360117 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b3fe8e47-6fca-41ca-a607-18a5280b7c2b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:07.367569 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b3fe8e47-6fca-41ca-a607-18a5280b7c2b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:07.368003 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b3fe8e47-6fca-41ca-a607-18a5280b7c2b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:07.368764 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b3fe8e47-6fca-41ca-a607-18a5280b7c2b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:07.369192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b3fe8e47-6fca-41ca-a607-18a5280b7c2b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:07.508267 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b3fe8e47-6fca-41ca-a607-18a5280b7c2b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:07.516617 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b3fe8e47-6fca-41ca-a607-18a5280b7c2b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.161390 May 13 14:56:07.517209 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 140/307] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:07 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:07.921033 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-68ff056c-3fab-44a2-a29e-eb7bd9c0f9ee tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:07.921604 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-68ff056c-3fab-44a2-a29e-eb7bd9c0f9ee tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:07.928222 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68ff056c-3fab-44a2-a29e-eb7bd9c0f9ee tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:07.928661 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68ff056c-3fab-44a2-a29e-eb7bd9c0f9ee tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:07.929422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68ff056c-3fab-44a2-a29e-eb7bd9c0f9ee tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:07.929844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68ff056c-3fab-44a2-a29e-eb7bd9c0f9ee tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:08.063616 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-68ff056c-3fab-44a2-a29e-eb7bd9c0f9ee tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:08.071105 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-68ff056c-3fab-44a2-a29e-eb7bd9c0f9ee tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1312 microversion: 2.1 time: 0.153942 May 13 14:56:08.071706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 168/308] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:07 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:08.533461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-735a4359-1f0c-471b-8f01-b3600466d6ec tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:08.534076 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-735a4359-1f0c-471b-8f01-b3600466d6ec tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:08.540687 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-735a4359-1f0c-471b-8f01-b3600466d6ec tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:08.541140 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-735a4359-1f0c-471b-8f01-b3600466d6ec tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:08.541886 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-735a4359-1f0c-471b-8f01-b3600466d6ec tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:08.542322 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-735a4359-1f0c-471b-8f01-b3600466d6ec tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:08.675906 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-735a4359-1f0c-471b-8f01-b3600466d6ec tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:08.683542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-735a4359-1f0c-471b-8f01-b3600466d6ec tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.154428 May 13 14:56:08.684136 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 141/309] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:08 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:09.088526 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c9ec6301-ac99-4c69-ada2-a510c994cd31 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:09.089099 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c9ec6301-ac99-4c69-ada2-a510c994cd31 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:09.095732 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c9ec6301-ac99-4c69-ada2-a510c994cd31 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:09.096201 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c9ec6301-ac99-4c69-ada2-a510c994cd31 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:09.096985 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c9ec6301-ac99-4c69-ada2-a510c994cd31 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:09.097415 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c9ec6301-ac99-4c69-ada2-a510c994cd31 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:09.230380 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c9ec6301-ac99-4c69-ada2-a510c994cd31 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:09.239195 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c9ec6301-ac99-4c69-ada2-a510c994cd31 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1312 microversion: 2.1 time: 0.154549 May 13 14:56:09.239746 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 169/310] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:09 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:56:09.704115 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7e1b9cfe-fb1d-489e-9d33-15c456879b88 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:09.704667 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7e1b9cfe-fb1d-489e-9d33-15c456879b88 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:09.711276 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7e1b9cfe-fb1d-489e-9d33-15c456879b88 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:09.712145 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7e1b9cfe-fb1d-489e-9d33-15c456879b88 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:09.712503 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7e1b9cfe-fb1d-489e-9d33-15c456879b88 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:09.713086 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7e1b9cfe-fb1d-489e-9d33-15c456879b88 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:09.842480 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7e1b9cfe-fb1d-489e-9d33-15c456879b88 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:09.851144 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7e1b9cfe-fb1d-489e-9d33-15c456879b88 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.153212 May 13 14:56:09.851734 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 142/311] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:09 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:10.257582 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f44d0365-6a43-482f-b534-12c2def0473b tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:10.258212 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f44d0365-6a43-482f-b534-12c2def0473b tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:10.265765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f44d0365-6a43-482f-b534-12c2def0473b tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:10.266364 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f44d0365-6a43-482f-b534-12c2def0473b tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:10.267150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f44d0365-6a43-482f-b534-12c2def0473b tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:10.267770 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f44d0365-6a43-482f-b534-12c2def0473b tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:10.414824 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f44d0365-6a43-482f-b534-12c2def0473b tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:10.424001 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f44d0365-6a43-482f-b534-12c2def0473b tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1312 microversion: 2.1 time: 0.170545 May 13 14:56:10.424578 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 170/312] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:10 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:10.869827 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-75e66562-df02-4c96-98e0-8ddfd09d37e8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:10.870467 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-75e66562-df02-4c96-98e0-8ddfd09d37e8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:10.878071 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-75e66562-df02-4c96-98e0-8ddfd09d37e8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:10.878526 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-75e66562-df02-4c96-98e0-8ddfd09d37e8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:10.879486 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-75e66562-df02-4c96-98e0-8ddfd09d37e8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:10.880043 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-75e66562-df02-4c96-98e0-8ddfd09d37e8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:11.044661 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-75e66562-df02-4c96-98e0-8ddfd09d37e8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:11.052831 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-75e66562-df02-4c96-98e0-8ddfd09d37e8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.187542 May 13 14:56:11.053462 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 143/313] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:10 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:11.441351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e67fa2ad-8561-4eab-9d1d-d997aea9f9e9 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:11.441953 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e67fa2ad-8561-4eab-9d1d-d997aea9f9e9 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:11.448696 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e67fa2ad-8561-4eab-9d1d-d997aea9f9e9 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:11.449137 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e67fa2ad-8561-4eab-9d1d-d997aea9f9e9 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:11.449888 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e67fa2ad-8561-4eab-9d1d-d997aea9f9e9 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:11.450316 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e67fa2ad-8561-4eab-9d1d-d997aea9f9e9 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:11.590849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e67fa2ad-8561-4eab-9d1d-d997aea9f9e9 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:11.600026 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e67fa2ad-8561-4eab-9d1d-d997aea9f9e9 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1312 microversion: 2.1 time: 0.162559 May 13 14:56:11.600590 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 171/314] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:11 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:12.075387 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6991aa2d-8dd6-4ba1-bad3-1465d278c113 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:12.075985 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6991aa2d-8dd6-4ba1-bad3-1465d278c113 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:12.083607 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6991aa2d-8dd6-4ba1-bad3-1465d278c113 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:12.084091 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6991aa2d-8dd6-4ba1-bad3-1465d278c113 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:12.084941 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6991aa2d-8dd6-4ba1-bad3-1465d278c113 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:12.085380 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6991aa2d-8dd6-4ba1-bad3-1465d278c113 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:12.225258 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6991aa2d-8dd6-4ba1-bad3-1465d278c113 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:12.233111 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6991aa2d-8dd6-4ba1-bad3-1465d278c113 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.161871 May 13 14:56:12.233686 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 144/315] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:12 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:12.617309 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c16bd5cb-8b64-4b5d-9135-3efdad898582 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:12.617941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c16bd5cb-8b64-4b5d-9135-3efdad898582 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:12.624465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c16bd5cb-8b64-4b5d-9135-3efdad898582 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:12.624915 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c16bd5cb-8b64-4b5d-9135-3efdad898582 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:12.626029 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c16bd5cb-8b64-4b5d-9135-3efdad898582 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:12.626562 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c16bd5cb-8b64-4b5d-9135-3efdad898582 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:12.764821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c16bd5cb-8b64-4b5d-9135-3efdad898582 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:12.772924 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c16bd5cb-8b64-4b5d-9135-3efdad898582 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1312 microversion: 2.1 time: 0.159502 May 13 14:56:12.773457 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 172/316] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:12 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:13.254107 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-35428bc5-10cd-4a85-bf5e-05665e73c782 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:13.254976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-35428bc5-10cd-4a85-bf5e-05665e73c782 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:13.265456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-35428bc5-10cd-4a85-bf5e-05665e73c782 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:13.266212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-35428bc5-10cd-4a85-bf5e-05665e73c782 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:13.267023 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-35428bc5-10cd-4a85-bf5e-05665e73c782 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:13.267459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-35428bc5-10cd-4a85-bf5e-05665e73c782 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:13.413580 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-35428bc5-10cd-4a85-bf5e-05665e73c782 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:13.421707 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-35428bc5-10cd-4a85-bf5e-05665e73c782 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.173966 May 13 14:56:13.422382 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 145/317] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:13 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:13.794995 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e91edfb3-0ee6-4b50-a4e4-5fa914d0eb63 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:13.795613 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e91edfb3-0ee6-4b50-a4e4-5fa914d0eb63 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:13.801832 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e91edfb3-0ee6-4b50-a4e4-5fa914d0eb63 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:13.802289 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e91edfb3-0ee6-4b50-a4e4-5fa914d0eb63 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:13.803096 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e91edfb3-0ee6-4b50-a4e4-5fa914d0eb63 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:13.803557 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e91edfb3-0ee6-4b50-a4e4-5fa914d0eb63 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:13.937601 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e91edfb3-0ee6-4b50-a4e4-5fa914d0eb63 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:13.945337 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e91edfb3-0ee6-4b50-a4e4-5fa914d0eb63 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1312 microversion: 2.1 time: 0.154584 May 13 14:56:13.946119 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 173/318] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:13 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:14.444050 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cc4c9799-7f36-4167-9257-2602805e4dd7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:14.444691 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-cc4c9799-7f36-4167-9257-2602805e4dd7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:14.451146 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cc4c9799-7f36-4167-9257-2602805e4dd7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:14.451596 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cc4c9799-7f36-4167-9257-2602805e4dd7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:14.452395 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cc4c9799-7f36-4167-9257-2602805e4dd7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:14.452830 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cc4c9799-7f36-4167-9257-2602805e4dd7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:14.595699 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-cc4c9799-7f36-4167-9257-2602805e4dd7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:14.603944 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-cc4c9799-7f36-4167-9257-2602805e4dd7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.163873 May 13 14:56:14.604553 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 146/319] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:14 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:14.963223 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-06dd3c6e-1860-4644-9c51-eb87827a8a04 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:14.964014 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-06dd3c6e-1860-4644-9c51-eb87827a8a04 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:14.970247 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-06dd3c6e-1860-4644-9c51-eb87827a8a04 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:14.970695 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-06dd3c6e-1860-4644-9c51-eb87827a8a04 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:14.971469 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-06dd3c6e-1860-4644-9c51-eb87827a8a04 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:14.971914 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-06dd3c6e-1860-4644-9c51-eb87827a8a04 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:15.108582 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-06dd3c6e-1860-4644-9c51-eb87827a8a04 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:15.116598 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-06dd3c6e-1860-4644-9c51-eb87827a8a04 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1312 microversion: 2.1 time: 0.157266 May 13 14:56:15.117278 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 174/320] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:14 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:15.622124 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-914e5b43-9124-45a5-b62e-fd95760ecc81 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:15.622997 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-914e5b43-9124-45a5-b62e-fd95760ecc81 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:15.636525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-914e5b43-9124-45a5-b62e-fd95760ecc81 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:15.637178 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-914e5b43-9124-45a5-b62e-fd95760ecc81 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:15.638104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-914e5b43-9124-45a5-b62e-fd95760ecc81 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:15.638882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-914e5b43-9124-45a5-b62e-fd95760ecc81 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:15.790446 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-914e5b43-9124-45a5-b62e-fd95760ecc81 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:15.799018 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-914e5b43-9124-45a5-b62e-fd95760ecc81 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.181068 May 13 14:56:15.799601 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 147/321] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:15 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:16.133757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f5ea2544-396c-460c-be97-74b40398357d tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:16.134319 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f5ea2544-396c-460c-be97-74b40398357d tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:16.140760 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f5ea2544-396c-460c-be97-74b40398357d tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:16.141234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f5ea2544-396c-460c-be97-74b40398357d tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:16.141993 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f5ea2544-396c-460c-be97-74b40398357d tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:16.142418 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f5ea2544-396c-460c-be97-74b40398357d tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:16.271023 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f5ea2544-396c-460c-be97-74b40398357d tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:16.279005 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f5ea2544-396c-460c-be97-74b40398357d tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1312 microversion: 2.1 time: 0.149122 May 13 14:56:16.279819 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 175/322] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:16 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:16.816533 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-db555d09-e7a4-4693-975b-9c3a629af905 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:16.817202 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-db555d09-e7a4-4693-975b-9c3a629af905 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:16.824845 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-db555d09-e7a4-4693-975b-9c3a629af905 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:16.825372 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-db555d09-e7a4-4693-975b-9c3a629af905 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:16.826294 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-db555d09-e7a4-4693-975b-9c3a629af905 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:16.826756 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-db555d09-e7a4-4693-975b-9c3a629af905 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:16.966181 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-db555d09-e7a4-4693-975b-9c3a629af905 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:16.973873 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-db555d09-e7a4-4693-975b-9c3a629af905 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1522 microversion: 2.1 time: 0.161355 May 13 14:56:16.974439 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 148/323] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:16 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:17.296649 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-274eacc6-9cf1-4e05-9c09-0e82cdc4b988 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:17.298165 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-274eacc6-9cf1-4e05-9c09-0e82cdc4b988 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:17.304352 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-274eacc6-9cf1-4e05-9c09-0e82cdc4b988 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:17.304803 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-274eacc6-9cf1-4e05-9c09-0e82cdc4b988 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:17.305580 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-274eacc6-9cf1-4e05-9c09-0e82cdc4b988 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:17.306016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-274eacc6-9cf1-4e05-9c09-0e82cdc4b988 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:17.442974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-274eacc6-9cf1-4e05-9c09-0e82cdc4b988 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:17.451149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-274eacc6-9cf1-4e05-9c09-0e82cdc4b988 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1312 microversion: 2.1 time: 0.158392 May 13 14:56:17.452015 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 176/324] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:17 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:17.593085 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-5b3bdadd-17f2-4b5d-9b2b-4d8539dd3991 req-4c7b6344-2dc1-4ee8-b569-6159f19fdc85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdaf8813-b010-4bbb-beb4-635a6f2b5f6c", "name": "network-vif-plugged", "status": "completed", "tag": "1e71d128-7333-4a05-adab-6241a47aa224"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:56:17.601226 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-5b3bdadd-17f2-4b5d-9b2b-4d8539dd3991 req-4c7b6344-2dc1-4ee8-b569-6159f19fdc85 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:17.601644 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-5b3bdadd-17f2-4b5d-9b2b-4d8539dd3991 req-4c7b6344-2dc1-4ee8-b569-6159f19fdc85 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:17.614184 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-5b3bdadd-17f2-4b5d-9b2b-4d8539dd3991 req-4c7b6344-2dc1-4ee8-b569-6159f19fdc85 service nova] Creating event network-vif-plugged:1e71d128-7333-4a05-adab-6241a47aa224 for instance cdaf8813-b010-4bbb-beb4-635a6f2b5f6c on hv-cinder-83090 May 13 14:56:17.619087 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-5b3bdadd-17f2-4b5d-9b2b-4d8539dd3991 req-4c7b6344-2dc1-4ee8-b569-6159f19fdc85 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029678 May 13 14:56:17.619677 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 149/325] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:56:17.990538 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e65c63df-471a-43b8-b3d1-a750df01f9bd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:17.991127 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e65c63df-471a-43b8-b3d1-a750df01f9bd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:17.997666 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e65c63df-471a-43b8-b3d1-a750df01f9bd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:17.998137 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e65c63df-471a-43b8-b3d1-a750df01f9bd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:17.999038 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e65c63df-471a-43b8-b3d1-a750df01f9bd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:17.999503 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e65c63df-471a-43b8-b3d1-a750df01f9bd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:18.151706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e65c63df-471a-43b8-b3d1-a750df01f9bd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:18.159343 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e65c63df-471a-43b8-b3d1-a750df01f9bd tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1502 microversion: 2.1 time: 0.172616 May 13 14:56:18.160142 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 177/326] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:17 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:56:18.176492 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f4d04abe-ed5f-4562-910d-9120b5134489 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:18.177186 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f4d04abe-ed5f-4562-910d-9120b5134489 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:18.183391 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f4d04abe-ed5f-4562-910d-9120b5134489 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:18.183835 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f4d04abe-ed5f-4562-910d-9120b5134489 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:18.184624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f4d04abe-ed5f-4562-910d-9120b5134489 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:18.185056 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f4d04abe-ed5f-4562-910d-9120b5134489 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:18.318538 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f4d04abe-ed5f-4562-910d-9120b5134489 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:18.326050 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f4d04abe-ed5f-4562-910d-9120b5134489 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1517 microversion: 2.1 time: 0.154163 May 13 14:56:18.326624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 150/327] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:18 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:18.468438 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-fa7f3795-2dae-47e9-b5cf-f519060757c4 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:18.469300 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-fa7f3795-2dae-47e9-b5cf-f519060757c4 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:18.475644 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fa7f3795-2dae-47e9-b5cf-f519060757c4 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:18.476137 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fa7f3795-2dae-47e9-b5cf-f519060757c4 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:18.476899 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fa7f3795-2dae-47e9-b5cf-f519060757c4 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:18.477331 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fa7f3795-2dae-47e9-b5cf-f519060757c4 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:18.633505 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-fa7f3795-2dae-47e9-b5cf-f519060757c4 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:18.642144 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-fa7f3795-2dae-47e9-b5cf-f519060757c4 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1312 microversion: 2.1 time: 0.177096 May 13 14:56:18.642420 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 178/328] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:18 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:19.659609 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9e0e5dd0-1ade-40eb-9520-b75b1effab90 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:19.660215 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-9e0e5dd0-1ade-40eb-9520-b75b1effab90 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:19.667005 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9e0e5dd0-1ade-40eb-9520-b75b1effab90 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:19.667450 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9e0e5dd0-1ade-40eb-9520-b75b1effab90 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:19.668260 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9e0e5dd0-1ade-40eb-9520-b75b1effab90 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:19.668693 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9e0e5dd0-1ade-40eb-9520-b75b1effab90 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:19.706757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-47112766-5ee7-4138-ab3c-2a6000706252 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:56:19.707725 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-47112766-5ee7-4138-ab3c-2a6000706252 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:19.713884 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-47112766-5ee7-4138-ab3c-2a6000706252 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:19.714708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-47112766-5ee7-4138-ab3c-2a6000706252 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:19.715136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-47112766-5ee7-4138-ab3c-2a6000706252 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:19.715564 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-47112766-5ee7-4138-ab3c-2a6000706252 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:19.739662 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-47112766-5ee7-4138-ab3c-2a6000706252 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lazy-loading 'flavor' on Instance uuid 4508cd58-3334-4af7-9c82-1e6e81fd4c4b {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:56:19.810496 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9e0e5dd0-1ade-40eb-9520-b75b1effab90 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:19.815082 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-47112766-5ee7-4138-ab3c-2a6000706252 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "POST /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b/action" status: 200 len: 32 microversion: 2.1 time: 0.112363 May 13 14:56:19.815754 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 179/329] 10.222.0.99 () {60 vars in 1277 bytes} [Fri May 13 14:56:19 2022] POST /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b/action => generated 32 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 14:56:19.820137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9e0e5dd0-1ade-40eb-9520-b75b1effab90 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1312 microversion: 2.1 time: 0.164910 May 13 14:56:19.820706 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 151/330] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:19 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1312 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:19.825489 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-1f3c7b94-0548-43c4-8216-2e46f5ae5304 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:19.826229 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-1f3c7b94-0548-43c4-8216-2e46f5ae5304 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:19.833151 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1f3c7b94-0548-43c4-8216-2e46f5ae5304 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:19.833600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1f3c7b94-0548-43c4-8216-2e46f5ae5304 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:19.834393 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1f3c7b94-0548-43c4-8216-2e46f5ae5304 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:19.834832 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1f3c7b94-0548-43c4-8216-2e46f5ae5304 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:19.977416 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-1f3c7b94-0548-43c4-8216-2e46f5ae5304 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:19.987692 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-1f3c7b94-0548-43c4-8216-2e46f5ae5304 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.166544 May 13 14:56:19.988327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 180/331] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:19 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:56:20.837181 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6b135ab5-9618-45b7-92c9-f0ae6c9a37f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:20.846072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6b135ab5-9618-45b7-92c9-f0ae6c9a37f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:20.846072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6b135ab5-9618-45b7-92c9-f0ae6c9a37f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:20.847036 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6b135ab5-9618-45b7-92c9-f0ae6c9a37f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:20.847036 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6b135ab5-9618-45b7-92c9-f0ae6c9a37f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:20.847422 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6b135ab5-9618-45b7-92c9-f0ae6c9a37f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:20.996924 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6b135ab5-9618-45b7-92c9-f0ae6c9a37f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:21.005775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ea77054a-6949-4efd-b736-e59bcb14b18a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:21.007023 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ea77054a-6949-4efd-b736-e59bcb14b18a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:21.007654 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6b135ab5-9618-45b7-92c9-f0ae6c9a37f2 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1495 microversion: 2.1 time: 0.174252 May 13 14:56:21.008745 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 152/332] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:20 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1495 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:21.033700 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ea77054a-6949-4efd-b736-e59bcb14b18a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:21.034168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ea77054a-6949-4efd-b736-e59bcb14b18a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:21.034977 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ea77054a-6949-4efd-b736-e59bcb14b18a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:21.035417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ea77054a-6949-4efd-b736-e59bcb14b18a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:21.411500 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ea77054a-6949-4efd-b736-e59bcb14b18a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:21.419593 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ea77054a-6949-4efd-b736-e59bcb14b18a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.418448 May 13 14:56:21.420234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 181/333] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:20 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:56:21.961405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-2ffb5500-aa29-42ab-9fb2-77219dfe4cda tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:21.962361 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-2ffb5500-aa29-42ab-9fb2-77219dfe4cda tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:21.969676 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2ffb5500-aa29-42ab-9fb2-77219dfe4cda tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:21.970254 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2ffb5500-aa29-42ab-9fb2-77219dfe4cda tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:21.971097 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2ffb5500-aa29-42ab-9fb2-77219dfe4cda tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:21.971587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2ffb5500-aa29-42ab-9fb2-77219dfe4cda tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:22.000740 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-2ffb5500-aa29-42ab-9fb2-77219dfe4cda tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Going to try to terminate instance {{(pid=117296) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:56:22.089314 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-2ffb5500-aa29-42ab-9fb2-77219dfe4cda tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "DELETE /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 204 len: 0 microversion: 2.1 time: 0.131563 May 13 14:56:22.089900 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 153/334] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 14:56:21 2022] DELETE /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:56:22.098305 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-fba79074-1c2c-471b-94c3-61cbe734d607 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:22.098945 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-fba79074-1c2c-471b-94c3-61cbe734d607 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:22.105290 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fba79074-1c2c-471b-94c3-61cbe734d607 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:22.105741 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fba79074-1c2c-471b-94c3-61cbe734d607 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:22.106514 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fba79074-1c2c-471b-94c3-61cbe734d607 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:22.106951 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fba79074-1c2c-471b-94c3-61cbe734d607 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:22.236268 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-fba79074-1c2c-471b-94c3-61cbe734d607 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:22.244206 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-fba79074-1c2c-471b-94c3-61cbe734d607 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1501 microversion: 2.1 time: 0.150012 May 13 14:56:22.244759 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 182/335] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:22 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1501 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:22.441874 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-07d811bd-97ec-42b8-be58-fcd9a3473394 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:22.442802 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-07d811bd-97ec-42b8-be58-fcd9a3473394 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:22.452462 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-07d811bd-97ec-42b8-be58-fcd9a3473394 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:22.453160 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-07d811bd-97ec-42b8-be58-fcd9a3473394 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:22.454294 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-07d811bd-97ec-42b8-be58-fcd9a3473394 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:22.454721 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-07d811bd-97ec-42b8-be58-fcd9a3473394 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:22.601141 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-07d811bd-97ec-42b8-be58-fcd9a3473394 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:22.619375 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-07d811bd-97ec-42b8-be58-fcd9a3473394 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.183019 May 13 14:56:22.620318 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 154/336] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:22 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:23.261368 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-456f1554-a4d5-4e13-bb61-db23a061cd42 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:23.262008 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-456f1554-a4d5-4e13-bb61-db23a061cd42 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:23.268853 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-456f1554-a4d5-4e13-bb61-db23a061cd42 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:23.269376 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-456f1554-a4d5-4e13-bb61-db23a061cd42 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:23.270076 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-456f1554-a4d5-4e13-bb61-db23a061cd42 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:23.270511 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-456f1554-a4d5-4e13-bb61-db23a061cd42 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:23.413888 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-456f1554-a4d5-4e13-bb61-db23a061cd42 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:23.425504 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-456f1554-a4d5-4e13-bb61-db23a061cd42 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1501 microversion: 2.1 time: 0.167874 May 13 14:56:23.426280 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 183/337] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:23 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:23.643747 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-83999c39-7105-4470-85e6-ebd12eb5f3b8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:23.644670 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-83999c39-7105-4470-85e6-ebd12eb5f3b8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:23.655819 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-83999c39-7105-4470-85e6-ebd12eb5f3b8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:23.656579 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-83999c39-7105-4470-85e6-ebd12eb5f3b8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:23.658242 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-83999c39-7105-4470-85e6-ebd12eb5f3b8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:23.658690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-83999c39-7105-4470-85e6-ebd12eb5f3b8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:23.799320 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-83999c39-7105-4470-85e6-ebd12eb5f3b8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:23.807462 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-83999c39-7105-4470-85e6-ebd12eb5f3b8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.171432 May 13 14:56:23.808061 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 155/338] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:23 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:24.448804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e24de6b7-5877-4b12-9d81-ff58712a22e4 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:24.449548 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e24de6b7-5877-4b12-9d81-ff58712a22e4 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:24.456746 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e24de6b7-5877-4b12-9d81-ff58712a22e4 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:24.457197 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e24de6b7-5877-4b12-9d81-ff58712a22e4 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:24.457983 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e24de6b7-5877-4b12-9d81-ff58712a22e4 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:24.458602 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e24de6b7-5877-4b12-9d81-ff58712a22e4 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:24.488111 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-465a8079-0baa-40eb-8fb5-9073a2e2726e req-34b51c74-0fb3-4b2e-83cd-4599ee353f37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdaf8813-b010-4bbb-beb4-635a6f2b5f6c", "name": "network-vif-deleted", "tag": "1e71d128-7333-4a05-adab-6241a47aa224"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:56:24.496788 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-465a8079-0baa-40eb-8fb5-9073a2e2726e req-34b51c74-0fb3-4b2e-83cd-4599ee353f37 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:24.497219 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-465a8079-0baa-40eb-8fb5-9073a2e2726e req-34b51c74-0fb3-4b2e-83cd-4599ee353f37 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:24.508545 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-465a8079-0baa-40eb-8fb5-9073a2e2726e req-34b51c74-0fb3-4b2e-83cd-4599ee353f37 service nova] Creating event network-vif-deleted:1e71d128-7333-4a05-adab-6241a47aa224 for instance cdaf8813-b010-4bbb-beb4-635a6f2b5f6c on hv-cinder-83090 May 13 14:56:24.515485 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-465a8079-0baa-40eb-8fb5-9073a2e2726e req-34b51c74-0fb3-4b2e-83cd-4599ee353f37 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031597 May 13 14:56:24.516256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 156/339] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:56:24.532913 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e24de6b7-5877-4b12-9d81-ff58712a22e4 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8b43419aba7485989facb2d0ed8f1aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96f1f8287c8c4c0da430dc5daef01813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:24.543394 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e24de6b7-5877-4b12-9d81-ff58712a22e4 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 200 len: 1459 microversion: 2.1 time: 0.098875 May 13 14:56:24.544387 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 184/340] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:24 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 1459 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:24.826582 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b3f99c49-8430-4005-8add-6fbe0a1b8f82 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:24.827326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b3f99c49-8430-4005-8add-6fbe0a1b8f82 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:24.834934 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b3f99c49-8430-4005-8add-6fbe0a1b8f82 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:24.835396 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b3f99c49-8430-4005-8add-6fbe0a1b8f82 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:24.836152 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b3f99c49-8430-4005-8add-6fbe0a1b8f82 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:24.836611 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b3f99c49-8430-4005-8add-6fbe0a1b8f82 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:24.972248 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b3f99c49-8430-4005-8add-6fbe0a1b8f82 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:24.980198 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b3f99c49-8430-4005-8add-6fbe0a1b8f82 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.158837 May 13 14:56:24.980791 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 157/341] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:24 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:25.564887 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-08bcabca-a8f0-4be8-805d-0a4e00a92d85 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:25.565458 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-08bcabca-a8f0-4be8-805d-0a4e00a92d85 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] [instance: cdaf8813-b010-4bbb-beb4-635a6f2b5f6c] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:25.573871 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-08bcabca-a8f0-4be8-805d-0a4e00a92d85 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:25.574460 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-08bcabca-a8f0-4be8-805d-0a4e00a92d85 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:25.575577 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-08bcabca-a8f0-4be8-805d-0a4e00a92d85 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:25.575948 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-08bcabca-a8f0-4be8-805d-0a4e00a92d85 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:25.595777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-08bcabca-a8f0-4be8-805d-0a4e00a92d85 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] HTTP exception thrown: Instance cdaf8813-b010-4bbb-beb4-635a6f2b5f6c could not be found. May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-08bcabca-a8f0-4be8-805d-0a4e00a92d85 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Request method failure captured: May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c HTTP/1.1 May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnFumlfg7ZOLqdiTBtkNsABGNSulbFiUpjnC1h0CNKUEUTbMHPZ14t6P9nGfKxnEygtoyjr3i0zoLdR6LJ3-wQwY_A3u74_jc65l09CF9eOxCZ_XoJw5q1o4g6XxhynGycYZSZR2G4SKZhtGzt7pl4bJjFzaUb9-H3OXlg3XbubByIw May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 96f1f8287c8c4c0da430dc5daef01813 May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-VolumesActionsTest-473642710 May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 14:56:25.597512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 14:56:25.598947 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_96f1f8287c8c4c0da430dc5daef01813", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/96f1f8287c8c4c0da430dc5daef01813"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/96f1f8287c8c4c0da430dc5daef01813"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/96f1f8287c8c4c0da430dc5daef01813"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:56:25.598947 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-VolumesActionsTest-473642710 May 13 14:56:25.598947 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 96f1f8287c8c4c0da430dc5daef01813 May 13 14:56:25.598947 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-VolumesActionsTest-473642710 May 13 14:56:25.598947 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-VolumesActionsTest-473642710-project May 13 14:56:25.598947 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 14:56:25.598947 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 14:56:25.598947 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: d8b43419aba7485989facb2d0ed8f1aa May 13 14:56:25.598947 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-VolumesActionsTest-473642710-project May 13 14:56:25.598947 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 14:56:25.598947 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance cdaf8813-b010-4bbb-beb4-635a6f2b5f6c could not be found. May 13 14:56:25.598947 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': 'cdaf8813-b010-4bbb-beb4-635a6f2b5f6c'} May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdaf8813-b010-4bbb-beb4-635a6f2b5f6c could not be found. May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:56:25.599808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdaf8813-b010-4bbb-beb4-635a6f2b5f6c could not be found. May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdaf8813-b010-4bbb-beb4-635a6f2b5f6c could not be found. May 13 14:56:25.601399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:56:25.602623 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-08bcabca-a8f0-4be8-805d-0a4e00a92d85 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] Returning 404 to user: Instance cdaf8813-b010-4bbb-beb4-635a6f2b5f6c could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:56:25.602623 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-08bcabca-a8f0-4be8-805d-0a4e00a92d85 tempest-VolumesActionsTest-473642710 tempest-VolumesActionsTest-473642710-project] 10.222.0.99 "GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c" status: 404 len: 111 microversion: 2.1 time: 0.039757 May 13 14:56:25.602623 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 185/342] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:25 2022] GET /compute/v2.1/servers/cdaf8813-b010-4bbb-beb4-635a6f2b5f6c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:56:25.998510 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-901375a3-90dc-4f0e-a688-93c794166c75 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:25.999149 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-901375a3-90dc-4f0e-a688-93c794166c75 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:26.006543 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-901375a3-90dc-4f0e-a688-93c794166c75 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:26.007002 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-901375a3-90dc-4f0e-a688-93c794166c75 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:26.007797 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-901375a3-90dc-4f0e-a688-93c794166c75 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:26.008256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-901375a3-90dc-4f0e-a688-93c794166c75 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:26.146484 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-901375a3-90dc-4f0e-a688-93c794166c75 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:26.154275 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-901375a3-90dc-4f0e-a688-93c794166c75 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.160725 May 13 14:56:26.154856 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 158/343] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:25 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:27.176137 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-90206e62-dde1-4db8-b18e-d0eef13dd0b1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:27.177144 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-90206e62-dde1-4db8-b18e-d0eef13dd0b1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:27.187453 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-90206e62-dde1-4db8-b18e-d0eef13dd0b1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:27.188272 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-90206e62-dde1-4db8-b18e-d0eef13dd0b1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:27.189564 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-90206e62-dde1-4db8-b18e-d0eef13dd0b1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:27.190494 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-90206e62-dde1-4db8-b18e-d0eef13dd0b1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:27.334401 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-90206e62-dde1-4db8-b18e-d0eef13dd0b1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:27.344034 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-90206e62-dde1-4db8-b18e-d0eef13dd0b1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.174255 May 13 14:56:27.344822 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 186/344] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:27 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:28.365212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7517c248-5993-4fa0-983d-33c6029aa490 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:28.366352 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7517c248-5993-4fa0-983d-33c6029aa490 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:28.374559 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7517c248-5993-4fa0-983d-33c6029aa490 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:28.375088 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7517c248-5993-4fa0-983d-33c6029aa490 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:28.376040 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7517c248-5993-4fa0-983d-33c6029aa490 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:28.376552 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7517c248-5993-4fa0-983d-33c6029aa490 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:28.526160 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7517c248-5993-4fa0-983d-33c6029aa490 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:28.533804 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7517c248-5993-4fa0-983d-33c6029aa490 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.175082 May 13 14:56:28.534481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 159/345] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:28 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:29.551537 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9695045e-6d7b-49ce-8847-095d2d36dd12 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:29.552174 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9695045e-6d7b-49ce-8847-095d2d36dd12 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:29.558983 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9695045e-6d7b-49ce-8847-095d2d36dd12 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:29.559434 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9695045e-6d7b-49ce-8847-095d2d36dd12 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:29.560252 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9695045e-6d7b-49ce-8847-095d2d36dd12 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:29.560682 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9695045e-6d7b-49ce-8847-095d2d36dd12 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:29.713474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9695045e-6d7b-49ce-8847-095d2d36dd12 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:29.722946 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9695045e-6d7b-49ce-8847-095d2d36dd12 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.175414 May 13 14:56:29.729821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 187/346] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:29 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:30.744596 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ca06157c-7d21-416a-a826-4e5dbb3f0766 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:30.745205 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ca06157c-7d21-416a-a826-4e5dbb3f0766 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:30.752171 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ca06157c-7d21-416a-a826-4e5dbb3f0766 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:30.752637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ca06157c-7d21-416a-a826-4e5dbb3f0766 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:30.753443 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ca06157c-7d21-416a-a826-4e5dbb3f0766 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:30.753869 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ca06157c-7d21-416a-a826-4e5dbb3f0766 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:30.895235 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ca06157c-7d21-416a-a826-4e5dbb3f0766 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:30.904213 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ca06157c-7d21-416a-a826-4e5dbb3f0766 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.165533 May 13 14:56:30.904988 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 160/347] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:30 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:31.928981 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-dd722c00-5331-4899-8bfd-41f5d0bcc8f9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:31.929828 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-dd722c00-5331-4899-8bfd-41f5d0bcc8f9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:31.944660 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dd722c00-5331-4899-8bfd-41f5d0bcc8f9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:31.945392 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dd722c00-5331-4899-8bfd-41f5d0bcc8f9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:31.946631 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dd722c00-5331-4899-8bfd-41f5d0bcc8f9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:31.947415 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dd722c00-5331-4899-8bfd-41f5d0bcc8f9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:32.086274 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-dd722c00-5331-4899-8bfd-41f5d0bcc8f9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:32.093891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-dd722c00-5331-4899-8bfd-41f5d0bcc8f9 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.171008 May 13 14:56:32.094477 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 188/348] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:31 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:33.114710 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7bdfb120-755e-4be7-b19f-9460352656d3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:33.115329 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7bdfb120-755e-4be7-b19f-9460352656d3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:33.122425 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7bdfb120-755e-4be7-b19f-9460352656d3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:33.122875 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7bdfb120-755e-4be7-b19f-9460352656d3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:33.123649 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7bdfb120-755e-4be7-b19f-9460352656d3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:33.124128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7bdfb120-755e-4be7-b19f-9460352656d3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:33.268694 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7bdfb120-755e-4be7-b19f-9460352656d3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:33.277366 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7bdfb120-755e-4be7-b19f-9460352656d3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.166507 May 13 14:56:33.277966 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 161/349] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:33 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:34.298743 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f171283f-b702-4693-8191-d64c72599b6b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:34.299696 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f171283f-b702-4693-8191-d64c72599b6b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:34.310243 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f171283f-b702-4693-8191-d64c72599b6b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:34.310943 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f171283f-b702-4693-8191-d64c72599b6b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:34.312264 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f171283f-b702-4693-8191-d64c72599b6b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:34.312935 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f171283f-b702-4693-8191-d64c72599b6b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:34.458566 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f171283f-b702-4693-8191-d64c72599b6b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:34.466816 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f171283f-b702-4693-8191-d64c72599b6b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.174054 May 13 14:56:34.467395 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 189/350] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:34 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:35.484710 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-4d91abe7-f861-4714-ab24-921d419bff37 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:35.485356 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-4d91abe7-f861-4714-ab24-921d419bff37 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:35.492812 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4d91abe7-f861-4714-ab24-921d419bff37 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:35.493272 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4d91abe7-f861-4714-ab24-921d419bff37 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:35.494054 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4d91abe7-f861-4714-ab24-921d419bff37 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:35.494866 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4d91abe7-f861-4714-ab24-921d419bff37 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:35.630206 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-4d91abe7-f861-4714-ab24-921d419bff37 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:35.638379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-4d91abe7-f861-4714-ab24-921d419bff37 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.157780 May 13 14:56:35.638971 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 162/351] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:35 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:36.654638 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-189a230c-0426-4214-a263-454b5e951c98 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:36.655246 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-189a230c-0426-4214-a263-454b5e951c98 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:36.661646 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-189a230c-0426-4214-a263-454b5e951c98 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:36.662085 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-189a230c-0426-4214-a263-454b5e951c98 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:36.662847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-189a230c-0426-4214-a263-454b5e951c98 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:36.663276 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-189a230c-0426-4214-a263-454b5e951c98 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:36.815905 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-189a230c-0426-4214-a263-454b5e951c98 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:36.824638 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-189a230c-0426-4214-a263-454b5e951c98 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.173874 May 13 14:56:36.825214 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 190/352] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:36 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:37.845593 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b9c80e70-320c-49ed-b685-8e84d101a337 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:37.846547 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b9c80e70-320c-49ed-b685-8e84d101a337 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:37.856819 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b9c80e70-320c-49ed-b685-8e84d101a337 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:37.857247 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b9c80e70-320c-49ed-b685-8e84d101a337 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:37.858067 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b9c80e70-320c-49ed-b685-8e84d101a337 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:37.858531 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b9c80e70-320c-49ed-b685-8e84d101a337 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:37.997365 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b9c80e70-320c-49ed-b685-8e84d101a337 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:38.010091 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b9c80e70-320c-49ed-b685-8e84d101a337 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.171050 May 13 14:56:38.010705 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 163/353] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:37 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:39.031389 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-1fe4a7b2-f2f4-4067-bfdb-ab432821bb11 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:39.032372 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-1fe4a7b2-f2f4-4067-bfdb-ab432821bb11 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:39.043545 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1fe4a7b2-f2f4-4067-bfdb-ab432821bb11 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:39.044343 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1fe4a7b2-f2f4-4067-bfdb-ab432821bb11 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:39.045613 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1fe4a7b2-f2f4-4067-bfdb-ab432821bb11 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:39.046296 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1fe4a7b2-f2f4-4067-bfdb-ab432821bb11 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:39.185593 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-1fe4a7b2-f2f4-4067-bfdb-ab432821bb11 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:39.196439 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-1fe4a7b2-f2f4-4067-bfdb-ab432821bb11 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.171306 May 13 14:56:39.197211 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 191/354] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:39 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:40.219410 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-55514d0d-6055-4d42-9b0e-208adeb50b6b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:40.219410 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-55514d0d-6055-4d42-9b0e-208adeb50b6b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:40.230875 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-55514d0d-6055-4d42-9b0e-208adeb50b6b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:40.231615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-55514d0d-6055-4d42-9b0e-208adeb50b6b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:40.232784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-55514d0d-6055-4d42-9b0e-208adeb50b6b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:40.233240 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-55514d0d-6055-4d42-9b0e-208adeb50b6b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:40.382787 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-55514d0d-6055-4d42-9b0e-208adeb50b6b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:40.393608 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-55514d0d-6055-4d42-9b0e-208adeb50b6b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.181613 May 13 14:56:40.394348 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 164/355] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:40 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:41.418670 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-0d3fe4ef-5cf4-441b-aadc-7936288a1bf5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:41.419990 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-0d3fe4ef-5cf4-441b-aadc-7936288a1bf5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:41.426503 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0d3fe4ef-5cf4-441b-aadc-7936288a1bf5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:41.426953 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0d3fe4ef-5cf4-441b-aadc-7936288a1bf5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:41.427731 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0d3fe4ef-5cf4-441b-aadc-7936288a1bf5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:41.428196 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0d3fe4ef-5cf4-441b-aadc-7936288a1bf5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:41.568833 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-0d3fe4ef-5cf4-441b-aadc-7936288a1bf5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:41.576911 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-0d3fe4ef-5cf4-441b-aadc-7936288a1bf5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.164834 May 13 14:56:41.577495 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 192/356] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:41 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:42.598371 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7dcc74c1-374f-4819-860b-2e3aa348d023 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:42.598949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7dcc74c1-374f-4819-860b-2e3aa348d023 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:42.605797 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7dcc74c1-374f-4819-860b-2e3aa348d023 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:42.606230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7dcc74c1-374f-4819-860b-2e3aa348d023 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:42.607204 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7dcc74c1-374f-4819-860b-2e3aa348d023 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:42.607641 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7dcc74c1-374f-4819-860b-2e3aa348d023 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:42.788004 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7dcc74c1-374f-4819-860b-2e3aa348d023 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:42.799144 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7dcc74c1-374f-4819-860b-2e3aa348d023 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.204139 May 13 14:56:42.800674 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 165/357] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:42 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:43.818788 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-84457e89-70be-4163-a318-203b4ae6767b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:43.818788 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-84457e89-70be-4163-a318-203b4ae6767b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:43.825751 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-84457e89-70be-4163-a318-203b4ae6767b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:43.826339 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-84457e89-70be-4163-a318-203b4ae6767b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:43.827282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-84457e89-70be-4163-a318-203b4ae6767b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:43.827819 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-84457e89-70be-4163-a318-203b4ae6767b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:43.973580 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-84457e89-70be-4163-a318-203b4ae6767b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:43.982418 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-84457e89-70be-4163-a318-203b4ae6767b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.170335 May 13 14:56:43.983391 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 193/358] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:43 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:45.004771 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f7d2c4fb-034a-47fe-86ac-b5f56e2952f2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:45.006410 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f7d2c4fb-034a-47fe-86ac-b5f56e2952f2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:45.016021 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f7d2c4fb-034a-47fe-86ac-b5f56e2952f2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:45.017048 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f7d2c4fb-034a-47fe-86ac-b5f56e2952f2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:45.018063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f7d2c4fb-034a-47fe-86ac-b5f56e2952f2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:45.018841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f7d2c4fb-034a-47fe-86ac-b5f56e2952f2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:45.209783 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f7d2c4fb-034a-47fe-86ac-b5f56e2952f2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:45.218354 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f7d2c4fb-034a-47fe-86ac-b5f56e2952f2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.218709 May 13 14:56:45.228592 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 166/359] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:44 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:46.236111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-6bf4a401-ed08-4105-80e4-48be13e9c59d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:46.236866 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-6bf4a401-ed08-4105-80e4-48be13e9c59d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:46.243244 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6bf4a401-ed08-4105-80e4-48be13e9c59d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:46.243695 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6bf4a401-ed08-4105-80e4-48be13e9c59d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:46.244515 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6bf4a401-ed08-4105-80e4-48be13e9c59d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:46.244947 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6bf4a401-ed08-4105-80e4-48be13e9c59d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:46.434603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-6bf4a401-ed08-4105-80e4-48be13e9c59d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:46.448941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-6bf4a401-ed08-4105-80e4-48be13e9c59d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.216144 May 13 14:56:46.450571 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 194/360] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:46 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:47.467416 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7c7843c6-e314-43d5-9009-c67630b2ba70 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:47.468417 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7c7843c6-e314-43d5-9009-c67630b2ba70 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:47.492501 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7c7843c6-e314-43d5-9009-c67630b2ba70 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:47.493244 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7c7843c6-e314-43d5-9009-c67630b2ba70 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:47.494042 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7c7843c6-e314-43d5-9009-c67630b2ba70 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:47.494633 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7c7843c6-e314-43d5-9009-c67630b2ba70 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:47.667398 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7c7843c6-e314-43d5-9009-c67630b2ba70 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:47.677689 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7c7843c6-e314-43d5-9009-c67630b2ba70 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.214034 May 13 14:56:47.679373 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 167/361] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:47 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:48.695531 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-34c7848d-b158-45fc-aa38-231d1f6975cc tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:48.697054 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-34c7848d-b158-45fc-aa38-231d1f6975cc tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:48.703858 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-34c7848d-b158-45fc-aa38-231d1f6975cc tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:48.704295 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-34c7848d-b158-45fc-aa38-231d1f6975cc tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:48.705301 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-34c7848d-b158-45fc-aa38-231d1f6975cc tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:48.705734 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-34c7848d-b158-45fc-aa38-231d1f6975cc tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:48.852432 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-34c7848d-b158-45fc-aa38-231d1f6975cc tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:48.860828 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-34c7848d-b158-45fc-aa38-231d1f6975cc tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1503 microversion: 2.1 time: 0.169089 May 13 14:56:48.861712 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 195/362] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:48 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:48.877592 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-36d7885b-a250-45ac-8009-1f5022485731 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d6560bd-0b6f-4b0f-837e-41c45b4cf39f"}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:56:48.879069 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-36d7885b-a250-45ac-8009-1f5022485731 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:48.885772 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-36d7885b-a250-45ac-8009-1f5022485731 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:48.886434 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-36d7885b-a250-45ac-8009-1f5022485731 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:48.887214 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-36d7885b-a250-45ac-8009-1f5022485731 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:48.887649 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-36d7885b-a250-45ac-8009-1f5022485731 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:48.914888 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-36d7885b-a250-45ac-8009-1f5022485731 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] HTTP exception thrown: Cannot 'attach_volume' instance 4508cd58-3334-4af7-9c82-1e6e81fd4c4b while it is in vm_state rescued May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-36d7885b-a250-45ac-8009-1f5022485731 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Request method failure captured: May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: POST /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b/os-volume_attachments HTTP/1.1 May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 74 May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnEX_YCathXpRmMcmTHQK870dglSF1vIXxzMt9X_shkAAeZwK4OTEv8qG1yD9PbTZPRObjiSCwpvBFNAjyx-LTvGwuXfzsCenvc4jAiGwqb8FMR9nOVYkdImh9s_ciWTDSnHjkxjTZz4HRMjY3xYhYqIBKRc16CgA1qR8RAGN_F-tSg May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 55a6554838094ba8a8b807bd90ec5bf4 May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-427117176 May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 14:56:48.917690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 14:56:48.918976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a6554838094ba8a8b807bd90ec5bf4", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a6554838094ba8a8b807bd90ec5bf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a6554838094ba8a8b807bd90ec5bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a6554838094ba8a8b807bd90ec5bf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:56:48.918976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-ServerRescueNegativeTestJSON-427117176 May 13 14:56:48.918976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 55a6554838094ba8a8b807bd90ec5bf4 May 13 14:56:48.918976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-427117176 May 13 14:56:48.918976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-ServerRescueNegativeTestJSON-427117176-project May 13 14:56:48.918976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 14:56:48.918976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 14:56:48.918976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: 18907451ac014573ba51f5f5f3939381 May 13 14:56:48.918976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-ServerRescueNegativeTestJSON-427117176-project May 13 14:56:48.918976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: May 13 14:56:48.918976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {"volumeAttachment": {"volumeId": "5d6560bd-0b6f-4b0f-837e-41c45b4cf39f"}} May 13 14:56:48.918976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Cannot 'attach_volume' instance 4508cd58-3334-4af7-9c82-1e6e81fd4c4b while it is in vm_state rescued May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'server_id': '4508cd58-3334-4af7-9c82-1e6e81fd4c4b', 'body': {'volumeAttachment': {'volumeId': '5d6560bd-0b6f-4b0f-837e-41c45b4cf39f'}}} May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4508cd58-3334-4af7-9c82-1e6e81fd4c4b in vm_state rescued. Cannot attach_volume while the instance is in this state. May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:56:48.919726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4508cd58-3334-4af7-9c82-1e6e81fd4c4b while it is in vm_state rescued May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:56:48.921494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:56:48.922590 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:56:48.922590 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:56:48.922590 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4508cd58-3334-4af7-9c82-1e6e81fd4c4b while it is in vm_state rescued May 13 14:56:48.922590 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:56:48.922590 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-36d7885b-a250-45ac-8009-1f5022485731 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Returning 409 to user: Cannot 'attach_volume' instance 4508cd58-3334-4af7-9c82-1e6e81fd4c4b while it is in vm_state rescued {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:56:48.922590 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-36d7885b-a250-45ac-8009-1f5022485731 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "POST /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045954 May 13 14:56:48.922590 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 168/363] 10.222.0.99 () {60 vars in 1322 bytes} [Fri May 13 14:56:48 2022] POST /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 13 14:56:48.929510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-781ac41b-d1f7-4276-bdfa-c558941c62f4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:56:48.930045 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-781ac41b-d1f7-4276-bdfa-c558941c62f4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:48.936899 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-781ac41b-d1f7-4276-bdfa-c558941c62f4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:48.937483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-781ac41b-d1f7-4276-bdfa-c558941c62f4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:48.938291 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-781ac41b-d1f7-4276-bdfa-c558941c62f4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:48.938728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-781ac41b-d1f7-4276-bdfa-c558941c62f4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:49.020564 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-781ac41b-d1f7-4276-bdfa-c558941c62f4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "POST /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b/action" status: 202 len: 0 microversion: 2.1 time: 0.094757 May 13 14:56:49.021202 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 196/364] 10.222.0.99 () {60 vars in 1277 bytes} [Fri May 13 14:56:48 2022] POST /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:56:49.029490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-691ace94-d37f-4a48-8536-fcbec13f6657 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:49.030434 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-691ace94-d37f-4a48-8536-fcbec13f6657 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:49.037492 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-691ace94-d37f-4a48-8536-fcbec13f6657 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:49.038264 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-691ace94-d37f-4a48-8536-fcbec13f6657 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:49.039236 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-691ace94-d37f-4a48-8536-fcbec13f6657 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:49.039817 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-691ace94-d37f-4a48-8536-fcbec13f6657 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:49.201889 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-691ace94-d37f-4a48-8536-fcbec13f6657 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:49.213095 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-691ace94-d37f-4a48-8536-fcbec13f6657 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1511 microversion: 2.1 time: 0.187314 May 13 14:56:49.213731 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 169/365] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:49 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:56:50.232485 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-0d801353-387a-4a66-826b-d8c1cb063d81 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:50.233929 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-0d801353-387a-4a66-826b-d8c1cb063d81 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:50.241299 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0d801353-387a-4a66-826b-d8c1cb063d81 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:50.242043 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0d801353-387a-4a66-826b-d8c1cb063d81 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:50.245108 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0d801353-387a-4a66-826b-d8c1cb063d81 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:50.245640 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0d801353-387a-4a66-826b-d8c1cb063d81 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:50.390329 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-0d801353-387a-4a66-826b-d8c1cb063d81 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:50.398986 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-0d801353-387a-4a66-826b-d8c1cb063d81 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1511 microversion: 2.1 time: 0.171621 May 13 14:56:50.399574 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 197/366] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:50 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:51.418135 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ab9b5836-ea19-4abe-8593-44021ce3bbc7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:51.419489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ab9b5836-ea19-4abe-8593-44021ce3bbc7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:51.426944 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ab9b5836-ea19-4abe-8593-44021ce3bbc7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:51.427397 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ab9b5836-ea19-4abe-8593-44021ce3bbc7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:51.428244 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ab9b5836-ea19-4abe-8593-44021ce3bbc7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:51.428686 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ab9b5836-ea19-4abe-8593-44021ce3bbc7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:51.616117 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ab9b5836-ea19-4abe-8593-44021ce3bbc7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:51.627694 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ab9b5836-ea19-4abe-8593-44021ce3bbc7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1511 microversion: 2.1 time: 0.213250 May 13 14:56:51.628344 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 170/367] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:51 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1511 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:52.645138 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4f7e9a9e-f5d4-4335-afd5-5e95862b38eb tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:52.646432 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4f7e9a9e-f5d4-4335-afd5-5e95862b38eb tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:52.652448 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4f7e9a9e-f5d4-4335-afd5-5e95862b38eb tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:52.653085 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4f7e9a9e-f5d4-4335-afd5-5e95862b38eb tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:52.654021 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4f7e9a9e-f5d4-4335-afd5-5e95862b38eb tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:52.654597 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4f7e9a9e-f5d4-4335-afd5-5e95862b38eb tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:52.798614 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4f7e9a9e-f5d4-4335-afd5-5e95862b38eb tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:52.806396 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4f7e9a9e-f5d4-4335-afd5-5e95862b38eb tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1511 microversion: 2.1 time: 0.165238 May 13 14:56:52.806970 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 198/368] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:52 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:56:53.824161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a37714c7-3c3e-490f-ad31-65d79a356a0a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:53.825513 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a37714c7-3c3e-490f-ad31-65d79a356a0a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:53.831765 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a37714c7-3c3e-490f-ad31-65d79a356a0a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:53.832254 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a37714c7-3c3e-490f-ad31-65d79a356a0a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:53.833034 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a37714c7-3c3e-490f-ad31-65d79a356a0a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:53.833469 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a37714c7-3c3e-490f-ad31-65d79a356a0a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:54.018091 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-a37714c7-3c3e-490f-ad31-65d79a356a0a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:54.026146 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a37714c7-3c3e-490f-ad31-65d79a356a0a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1511 microversion: 2.1 time: 0.206007 May 13 14:56:54.026755 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 171/369] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:53 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1511 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:55.042873 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3dd209b2-c719-4900-ba34-e7ed567d23f0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:55.043503 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3dd209b2-c719-4900-ba34-e7ed567d23f0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:55.050732 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3dd209b2-c719-4900-ba34-e7ed567d23f0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:55.051185 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3dd209b2-c719-4900-ba34-e7ed567d23f0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:55.052000 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3dd209b2-c719-4900-ba34-e7ed567d23f0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:55.052442 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3dd209b2-c719-4900-ba34-e7ed567d23f0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:55.199022 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3dd209b2-c719-4900-ba34-e7ed567d23f0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:55.207932 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3dd209b2-c719-4900-ba34-e7ed567d23f0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1511 microversion: 2.1 time: 0.168981 May 13 14:56:55.208806 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 199/370] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:55 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:56:56.225756 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6d443134-c7a5-4719-8231-c6d6b4e684e0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:56.227517 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6d443134-c7a5-4719-8231-c6d6b4e684e0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:56.234878 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6d443134-c7a5-4719-8231-c6d6b4e684e0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:56.235319 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6d443134-c7a5-4719-8231-c6d6b4e684e0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:56.236536 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6d443134-c7a5-4719-8231-c6d6b4e684e0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:56.237036 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6d443134-c7a5-4719-8231-c6d6b4e684e0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:56.395820 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6d443134-c7a5-4719-8231-c6d6b4e684e0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:56.406508 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6d443134-c7a5-4719-8231-c6d6b4e684e0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1511 microversion: 2.1 time: 0.184845 May 13 14:56:56.416356 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 172/371] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:56 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1511 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:57.424649 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e5b02321-2efe-4dc7-bf27-0abc6beaaaed tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:57.425295 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e5b02321-2efe-4dc7-bf27-0abc6beaaaed tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:57.432300 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e5b02321-2efe-4dc7-bf27-0abc6beaaaed tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:57.432755 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e5b02321-2efe-4dc7-bf27-0abc6beaaaed tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:57.433555 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e5b02321-2efe-4dc7-bf27-0abc6beaaaed tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:57.433990 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e5b02321-2efe-4dc7-bf27-0abc6beaaaed tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:57.597111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e5b02321-2efe-4dc7-bf27-0abc6beaaaed tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:57.605485 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e5b02321-2efe-4dc7-bf27-0abc6beaaaed tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1511 microversion: 2.1 time: 0.185822 May 13 14:56:57.606157 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 200/372] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:57 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1511 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:56:58.623917 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a04d8422-9653-46b2-aea7-ee1c4708dea7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:56:58.624627 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a04d8422-9653-46b2-aea7-ee1c4708dea7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:56:58.632031 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a04d8422-9653-46b2-aea7-ee1c4708dea7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:58.632558 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a04d8422-9653-46b2-aea7-ee1c4708dea7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:58.633449 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a04d8422-9653-46b2-aea7-ee1c4708dea7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:56:58.634065 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a04d8422-9653-46b2-aea7-ee1c4708dea7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:56:58.794993 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-a04d8422-9653-46b2-aea7-ee1c4708dea7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:56:58.803179 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a04d8422-9653-46b2-aea7-ee1c4708dea7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1517 microversion: 2.1 time: 0.183393 May 13 14:56:58.803773 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 173/373] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:56:58 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:00.172956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-822f1d95-fa6a-49c7-9772-afc4c1d0aa53 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Action: 'create', calling method: .version_select at 0x7fcf4834b790>, body: {"keypair": {"name": "tempest-keypair-679290579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAB/7pUhOejD1NPEj/gMWBNU0w+RmM/YBnhjm72LHVCC+v9XL0ZbXBGIFY83SHntu53BqS03VAXyBg45gKrxk2SL4KzSvNUcuV1JrJS8UBrRp/YMjXyBMMxk2fFfRInPMQ=="}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:00.186791 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-822f1d95-fa6a-49c7-9772-afc4c1d0aa53 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Getting quotas for project 55a6554838094ba8a8b807bd90ec5bf4. Resources: {'key_pairs'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:57:00.190595 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-822f1d95-fa6a-49c7-9772-afc4c1d0aa53 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Getting quotas for user 18907451ac014573ba51f5f5f3939381 and project 55a6554838094ba8a8b807bd90ec5bf4. Resources: {'key_pairs'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:57:00.214277 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-822f1d95-fa6a-49c7-9772-afc4c1d0aa53 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045532 May 13 14:57:00.215224 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 201/374] 10.222.0.99 () {60 vars in 1158 bytes} [Fri May 13 14:57:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:57:01.604928 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a3e0bb95-1500-45a5-bbb5-61610d295d80 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-573861242", "imageRef": "eac0bc7b-d963-4624-aba3-a81fd1bf324c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a7b2298-9e34-420b-b30f-2b0ff9798ff9"}], "security_groups": [{"name": "tempest-securitygroup--2006733646"}], "key_name": "tempest-keypair-679290579", "user_data": "}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:01.726888 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.network.neutron [None req-a3e0bb95-1500-45a5-bbb5-61610d295d80 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] validate_networks() for [('5a7b2298-9e34-420b-b30f-2b0ff9798ff9', None, None, None, None, None)] {{(pid=117296) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:57:02.190410 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-a3e0bb95-1500-45a5-bbb5-61610d295d80 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Flavor limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:57:02.190831 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-a3e0bb95-1500-45a5-bbb5-61610d295d80 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Image limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:57:02.191302 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-a3e0bb95-1500-45a5-bbb5-61610d295d80 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Flavor pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:57:02.191716 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-a3e0bb95-1500-45a5-bbb5-61610d295d80 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Image pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:57:02.192151 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-a3e0bb95-1500-45a5-bbb5-61610d295d80 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:57:02.200969 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a3e0bb95-1500-45a5-bbb5-61610d295d80 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:02.201420 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a3e0bb95-1500-45a5-bbb5-61610d295d80 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:02.202228 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a3e0bb95-1500-45a5-bbb5-61610d295d80 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:02.202666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a3e0bb95-1500-45a5-bbb5-61610d295d80 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:02.221576 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-a3e0bb95-1500-45a5-bbb5-61610d295d80 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Getting quotas for project 55a6554838094ba8a8b807bd90ec5bf4. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:57:02.226083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-a3e0bb95-1500-45a5-bbb5-61610d295d80 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Getting quotas for user 18907451ac014573ba51f5f5f3939381 and project 55a6554838094ba8a8b807bd90ec5bf4. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:57:02.240923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a3e0bb95-1500-45a5-bbb5-61610d295d80 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Going to run 1 instances... {{(pid=117296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:57:02.243202 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a3e0bb95-1500-45a5-bbb5-61610d295d80 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac0bc7b-d963-4624-aba3-a81fd1bf324c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:57:02.296060 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a3e0bb95-1500-45a5-bbb5-61610d295d80 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.695569 May 13 14:57:02.296694 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 174/375] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 14:57:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:57:02.307365 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-413d6ade-9fe9-420f-92e1-405bec8a5ee3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:02.308210 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-413d6ade-9fe9-420f-92e1-405bec8a5ee3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:02.382005 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-413d6ade-9fe9-420f-92e1-405bec8a5ee3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:02.396016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-413d6ade-9fe9-420f-92e1-405bec8a5ee3 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1244 microversion: 2.1 time: 0.086482 May 13 14:57:02.399811 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 202/376] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:02 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1244 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:03.408076 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-eb557896-257d-4359-b290-fd214d4d137e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:03.408660 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-eb557896-257d-4359-b290-fd214d4d137e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:03.421647 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-eb557896-257d-4359-b290-fd214d4d137e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:03.422923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-eb557896-257d-4359-b290-fd214d4d137e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:03.424717 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-eb557896-257d-4359-b290-fd214d4d137e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:03.425468 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-eb557896-257d-4359-b290-fd214d4d137e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:03.528772 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-eb557896-257d-4359-b290-fd214d4d137e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:03.538965 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-eb557896-257d-4359-b290-fd214d4d137e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1304 microversion: 2.1 time: 0.135285 May 13 14:57:03.539857 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 175/377] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:03 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1304 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:04.556271 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-57d46a72-ffd8-4268-b1f1-277f2f673c05 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:04.557121 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-57d46a72-ffd8-4268-b1f1-277f2f673c05 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:04.570552 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-57d46a72-ffd8-4268-b1f1-277f2f673c05 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:04.571364 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-57d46a72-ffd8-4268-b1f1-277f2f673c05 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:04.572856 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-57d46a72-ffd8-4268-b1f1-277f2f673c05 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:04.573294 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-57d46a72-ffd8-4268-b1f1-277f2f673c05 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:04.728957 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-57d46a72-ffd8-4268-b1f1-277f2f673c05 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:04.736830 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-57d46a72-ffd8-4268-b1f1-277f2f673c05 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1370 microversion: 2.1 time: 0.184550 May 13 14:57:04.737401 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 203/378] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:04 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:05.154592 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-f153c94b-2b61-474d-a868-a2f9eae3b4fb req-2d48c5e3-ecc0-4d95-a618-77d2d8f4ca4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15fd606f-6ebc-46d6-9fe8-bd7219c22f27", "tag": "751bef1d-e5f5-41a9-bbf3-44c2a5dc804c"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:05.167364 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-f153c94b-2b61-474d-a868-a2f9eae3b4fb req-2d48c5e3-ecc0-4d95-a618-77d2d8f4ca4f service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:05.168079 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-f153c94b-2b61-474d-a868-a2f9eae3b4fb req-2d48c5e3-ecc0-4d95-a618-77d2d8f4ca4f service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:05.181970 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-f153c94b-2b61-474d-a868-a2f9eae3b4fb req-2d48c5e3-ecc0-4d95-a618-77d2d8f4ca4f service nova] Creating event network-changed:751bef1d-e5f5-41a9-bbf3-44c2a5dc804c for instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 on hv-cinder-83090 May 13 14:57:05.189780 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-f153c94b-2b61-474d-a868-a2f9eae3b4fb req-2d48c5e3-ecc0-4d95-a618-77d2d8f4ca4f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038829 May 13 14:57:05.190973 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 176/379] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:57:05.650353 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-a04be118-3819-4ea6-b0d4-7cc960a8fcb0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1751328349", "imageRef": "eac0bc7b-d963-4624-aba3-a81fd1bf324c", "flavorRef": "452", "networks": [{"uuid": "c7b57fa3-00c8-4e2a-afac-0dc64b67c56e"}]}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:05.707401 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.network.neutron [None req-a04be118-3819-4ea6-b0d4-7cc960a8fcb0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] validate_networks() for [('c7b57fa3-00c8-4e2a-afac-0dc64b67c56e', None, None, None, None, None)] {{(pid=117295) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:57:05.754392 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-0784a5a9-c615-4c68-9727-c45d727b361c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:05.755293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-0784a5a9-c615-4c68-9727-c45d727b361c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:05.761825 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0784a5a9-c615-4c68-9727-c45d727b361c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:05.762266 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0784a5a9-c615-4c68-9727-c45d727b361c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:05.763034 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0784a5a9-c615-4c68-9727-c45d727b361c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:05.763465 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0784a5a9-c615-4c68-9727-c45d727b361c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:05.967507 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-0784a5a9-c615-4c68-9727-c45d727b361c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:05.976259 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-0784a5a9-c615-4c68-9727-c45d727b361c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1370 microversion: 2.1 time: 0.226101 May 13 14:57:05.977462 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 177/380] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:05 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1370 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:57:06.133231 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-a04be118-3819-4ea6-b0d4-7cc960a8fcb0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Flavor limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:57:06.133670 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-a04be118-3819-4ea6-b0d4-7cc960a8fcb0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Image limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:57:06.134147 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-a04be118-3819-4ea6-b0d4-7cc960a8fcb0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Flavor pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:57:06.134761 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-a04be118-3819-4ea6-b0d4-7cc960a8fcb0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Image pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:57:06.135297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-a04be118-3819-4ea6-b0d4-7cc960a8fcb0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:57:06.144630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a04be118-3819-4ea6-b0d4-7cc960a8fcb0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:06.145075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a04be118-3819-4ea6-b0d4-7cc960a8fcb0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:06.145877 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a04be118-3819-4ea6-b0d4-7cc960a8fcb0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:06.146338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a04be118-3819-4ea6-b0d4-7cc960a8fcb0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:06.163316 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-a04be118-3819-4ea6-b0d4-7cc960a8fcb0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Getting quotas for project 9cf795995a52452f93da8f04eb878e7b. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:57:06.167220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-a04be118-3819-4ea6-b0d4-7cc960a8fcb0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Getting quotas for user 08b114f5b57146d8b4324231982ce7d4 and project 9cf795995a52452f93da8f04eb878e7b. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:57:06.178718 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-a04be118-3819-4ea6-b0d4-7cc960a8fcb0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Going to run 1 instances... {{(pid=117295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:57:06.180959 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-a04be118-3819-4ea6-b0d4-7cc960a8fcb0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac0bc7b-d963-4624-aba3-a81fd1bf324c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:57:06.228093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-a04be118-3819-4ea6-b0d4-7cc960a8fcb0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586799 May 13 14:57:06.228846 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 204/381] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 14:57:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:57:06.240442 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a9fe48be-bcea-4d54-8a28-b11d85aa297e tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:06.241940 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a9fe48be-bcea-4d54-8a28-b11d85aa297e tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:06.303190 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-a9fe48be-bcea-4d54-8a28-b11d85aa297e tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:06.311791 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a9fe48be-bcea-4d54-8a28-b11d85aa297e tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1219 microversion: 2.1 time: 0.076073 May 13 14:57:06.312531 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 178/382] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:06 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:06.994003 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-a8d18c84-3bda-4da9-a6fc-7a5fec5cb0af tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:06.995248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-a8d18c84-3bda-4da9-a6fc-7a5fec5cb0af tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:07.001855 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a8d18c84-3bda-4da9-a6fc-7a5fec5cb0af tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:07.002309 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a8d18c84-3bda-4da9-a6fc-7a5fec5cb0af tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:07.003095 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a8d18c84-3bda-4da9-a6fc-7a5fec5cb0af tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:07.003533 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a8d18c84-3bda-4da9-a6fc-7a5fec5cb0af tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:07.133446 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-a8d18c84-3bda-4da9-a6fc-7a5fec5cb0af tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:07.140746 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-a8d18c84-3bda-4da9-a6fc-7a5fec5cb0af tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1370 microversion: 2.1 time: 0.150646 May 13 14:57:07.141493 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 205/383] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:06 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:07.330786 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ef35d9d5-a402-432f-a32b-f3f295a20576 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:07.331439 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ef35d9d5-a402-432f-a32b-f3f295a20576 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:07.338704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ef35d9d5-a402-432f-a32b-f3f295a20576 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:07.339148 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ef35d9d5-a402-432f-a32b-f3f295a20576 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:07.339961 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ef35d9d5-a402-432f-a32b-f3f295a20576 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:07.340401 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ef35d9d5-a402-432f-a32b-f3f295a20576 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:07.404722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ef35d9d5-a402-432f-a32b-f3f295a20576 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:07.412328 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ef35d9d5-a402-432f-a32b-f3f295a20576 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1223 microversion: 2.1 time: 0.085357 May 13 14:57:07.412904 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 179/384] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:07 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:08.161510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-898ac90f-14a9-4dfe-b248-6012bcc70b52 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:08.162206 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-898ac90f-14a9-4dfe-b248-6012bcc70b52 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:08.170140 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-898ac90f-14a9-4dfe-b248-6012bcc70b52 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:08.170658 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-898ac90f-14a9-4dfe-b248-6012bcc70b52 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:08.171563 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-898ac90f-14a9-4dfe-b248-6012bcc70b52 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:08.172119 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-898ac90f-14a9-4dfe-b248-6012bcc70b52 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:08.301077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-898ac90f-14a9-4dfe-b248-6012bcc70b52 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:08.308485 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-898ac90f-14a9-4dfe-b248-6012bcc70b52 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1370 microversion: 2.1 time: 0.152786 May 13 14:57:08.309050 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 206/385] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:08 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:08.433274 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3a7a9e63-f694-4fef-8c23-6e94fa3b8677 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:08.433945 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-3a7a9e63-f694-4fef-8c23-6e94fa3b8677 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:08.444740 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a7a9e63-f694-4fef-8c23-6e94fa3b8677 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:08.445439 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a7a9e63-f694-4fef-8c23-6e94fa3b8677 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:08.446722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a7a9e63-f694-4fef-8c23-6e94fa3b8677 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:08.447410 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a7a9e63-f694-4fef-8c23-6e94fa3b8677 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:08.512449 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3a7a9e63-f694-4fef-8c23-6e94fa3b8677 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:08.521056 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-3a7a9e63-f694-4fef-8c23-6e94fa3b8677 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1223 microversion: 2.1 time: 0.094417 May 13 14:57:08.521641 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 180/386] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:08 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:09.328685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d2779797-c2e9-4e1f-9cd6-7bb9476356ef tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:09.330772 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d2779797-c2e9-4e1f-9cd6-7bb9476356ef tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:09.342193 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d2779797-c2e9-4e1f-9cd6-7bb9476356ef tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:09.342982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d2779797-c2e9-4e1f-9cd6-7bb9476356ef tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:09.344085 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d2779797-c2e9-4e1f-9cd6-7bb9476356ef tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:09.344962 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d2779797-c2e9-4e1f-9cd6-7bb9476356ef tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:09.498240 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d2779797-c2e9-4e1f-9cd6-7bb9476356ef tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:09.507996 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d2779797-c2e9-4e1f-9cd6-7bb9476356ef tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1370 microversion: 2.1 time: 0.185883 May 13 14:57:09.508703 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 207/387] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:09 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:09.538278 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-986768ac-879c-4d2b-bc08-300eedfbbf40 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:09.538940 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-986768ac-879c-4d2b-bc08-300eedfbbf40 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:09.545106 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-986768ac-879c-4d2b-bc08-300eedfbbf40 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:09.545542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-986768ac-879c-4d2b-bc08-300eedfbbf40 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:09.546300 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-986768ac-879c-4d2b-bc08-300eedfbbf40 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:09.546719 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-986768ac-879c-4d2b-bc08-300eedfbbf40 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:09.613818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-986768ac-879c-4d2b-bc08-300eedfbbf40 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:09.622925 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-986768ac-879c-4d2b-bc08-300eedfbbf40 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1271 microversion: 2.1 time: 0.088257 May 13 14:57:09.632537 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 181/388] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:09 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:10.525475 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9a00fa68-3980-47c5-996b-4b8c3c1bdda2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:10.526161 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9a00fa68-3980-47c5-996b-4b8c3c1bdda2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:10.532984 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9a00fa68-3980-47c5-996b-4b8c3c1bdda2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:10.533503 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9a00fa68-3980-47c5-996b-4b8c3c1bdda2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:10.534265 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9a00fa68-3980-47c5-996b-4b8c3c1bdda2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:10.534948 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9a00fa68-3980-47c5-996b-4b8c3c1bdda2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:10.640591 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-11074bd7-1432-4501-ae27-110e1825d96b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:10.642126 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-11074bd7-1432-4501-ae27-110e1825d96b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:10.648796 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-11074bd7-1432-4501-ae27-110e1825d96b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:10.649558 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-11074bd7-1432-4501-ae27-110e1825d96b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:10.650591 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-11074bd7-1432-4501-ae27-110e1825d96b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:10.651310 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-11074bd7-1432-4501-ae27-110e1825d96b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:10.681491 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9a00fa68-3980-47c5-996b-4b8c3c1bdda2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:10.689748 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9a00fa68-3980-47c5-996b-4b8c3c1bdda2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1370 microversion: 2.1 time: 0.168220 May 13 14:57:10.699793 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 208/389] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:10 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:57:10.745614 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-5122eeb3-2f0d-402d-9c39-ca0c69a18b57 req-9dc746bd-c86b-45f8-9983-3a3a70cb9681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15fd606f-6ebc-46d6-9fe8-bd7219c22f27", "name": "network-vif-plugged", "status": "completed", "tag": "751bef1d-e5f5-41a9-bbf3-44c2a5dc804c"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:10.758247 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-5122eeb3-2f0d-402d-9c39-ca0c69a18b57 req-9dc746bd-c86b-45f8-9983-3a3a70cb9681 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:10.758689 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-5122eeb3-2f0d-402d-9c39-ca0c69a18b57 req-9dc746bd-c86b-45f8-9983-3a3a70cb9681 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:10.777772 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-5122eeb3-2f0d-402d-9c39-ca0c69a18b57 req-9dc746bd-c86b-45f8-9983-3a3a70cb9681 service nova] Creating event network-vif-plugged:751bef1d-e5f5-41a9-bbf3-44c2a5dc804c for instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 on hv-cinder-83090 May 13 14:57:10.786767 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-5122eeb3-2f0d-402d-9c39-ca0c69a18b57 req-9dc746bd-c86b-45f8-9983-3a3a70cb9681 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045104 May 13 14:57:10.787838 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 209/390] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:57:10.829002 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-11074bd7-1432-4501-ae27-110e1825d96b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:10.838122 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-11074bd7-1432-4501-ae27-110e1825d96b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1319 microversion: 2.1 time: 0.202023 May 13 14:57:10.838970 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 182/391] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:10 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:57:11.364061 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-c708a567-349a-4e73-a3f4-fb916de2352e req-f7920b89-b81a-4ada-9db4-e89cfc70dc75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa4062d3-a547-4be9-b840-e5f9a4ca1205", "tag": "99ba8426-1b1e-44a7-8c7d-58c7127f89ae"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:11.372471 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-c708a567-349a-4e73-a3f4-fb916de2352e req-f7920b89-b81a-4ada-9db4-e89cfc70dc75 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:11.372912 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-c708a567-349a-4e73-a3f4-fb916de2352e req-f7920b89-b81a-4ada-9db4-e89cfc70dc75 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:11.384013 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-c708a567-349a-4e73-a3f4-fb916de2352e req-f7920b89-b81a-4ada-9db4-e89cfc70dc75 service nova] Creating event network-changed:99ba8426-1b1e-44a7-8c7d-58c7127f89ae for instance fa4062d3-a547-4be9-b840-e5f9a4ca1205 on hv-cinder-83090 May 13 14:57:11.390325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-c708a567-349a-4e73-a3f4-fb916de2352e req-f7920b89-b81a-4ada-9db4-e89cfc70dc75 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035482 May 13 14:57:11.395619 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 210/392] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:57:11.711084 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-011a96b6-33db-45fb-8f4d-bd16f5e11858 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:11.711775 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-011a96b6-33db-45fb-8f4d-bd16f5e11858 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:11.721974 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-011a96b6-33db-45fb-8f4d-bd16f5e11858 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:11.722651 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-011a96b6-33db-45fb-8f4d-bd16f5e11858 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:11.723444 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-011a96b6-33db-45fb-8f4d-bd16f5e11858 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:11.723903 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-011a96b6-33db-45fb-8f4d-bd16f5e11858 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:11.861674 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-068a21bb-77ce-44a3-a38e-bf4a0622a3ff tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:11.863064 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-068a21bb-77ce-44a3-a38e-bf4a0622a3ff tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:11.873994 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-068a21bb-77ce-44a3-a38e-bf4a0622a3ff tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:11.875297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-068a21bb-77ce-44a3-a38e-bf4a0622a3ff tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:11.877079 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-068a21bb-77ce-44a3-a38e-bf4a0622a3ff tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:11.877910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-068a21bb-77ce-44a3-a38e-bf4a0622a3ff tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:11.884825 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-011a96b6-33db-45fb-8f4d-bd16f5e11858 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:11.893080 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-011a96b6-33db-45fb-8f4d-bd16f5e11858 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1370 microversion: 2.1 time: 0.187831 May 13 14:57:11.893638 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 183/393] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:11 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:12.041747 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-068a21bb-77ce-44a3-a38e-bf4a0622a3ff tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:12.053506 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-068a21bb-77ce-44a3-a38e-bf4a0622a3ff tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1319 microversion: 2.1 time: 0.200316 May 13 14:57:12.054709 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 211/394] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:11 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:57:12.912654 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-acc74a12-6e40-46ff-a780-97db70958cc4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:12.913214 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-acc74a12-6e40-46ff-a780-97db70958cc4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:12.919900 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-acc74a12-6e40-46ff-a780-97db70958cc4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:12.920366 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-acc74a12-6e40-46ff-a780-97db70958cc4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:12.921140 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-acc74a12-6e40-46ff-a780-97db70958cc4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:12.921593 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-acc74a12-6e40-46ff-a780-97db70958cc4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:13.063121 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-acc74a12-6e40-46ff-a780-97db70958cc4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:13.071219 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-acc74a12-6e40-46ff-a780-97db70958cc4 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1370 microversion: 2.1 time: 0.163186 May 13 14:57:13.071828 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 184/395] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:12 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:13.072370 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-fecf562a-c0f6-44be-a776-33c7c4edb664 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:13.073098 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-fecf562a-c0f6-44be-a776-33c7c4edb664 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:13.079765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fecf562a-c0f6-44be-a776-33c7c4edb664 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:13.080520 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fecf562a-c0f6-44be-a776-33c7c4edb664 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:13.081336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fecf562a-c0f6-44be-a776-33c7c4edb664 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:13.081765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fecf562a-c0f6-44be-a776-33c7c4edb664 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:13.228778 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-fecf562a-c0f6-44be-a776-33c7c4edb664 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:13.241362 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-fecf562a-c0f6-44be-a776-33c7c4edb664 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1319 microversion: 2.1 time: 0.172586 May 13 14:57:13.242222 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 212/396] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:13 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:14.089598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b3baf1fd-611f-477f-91d6-e2fef8629df2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:14.091167 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b3baf1fd-611f-477f-91d6-e2fef8629df2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:14.098644 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b3baf1fd-611f-477f-91d6-e2fef8629df2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:14.099093 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b3baf1fd-611f-477f-91d6-e2fef8629df2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:14.099901 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b3baf1fd-611f-477f-91d6-e2fef8629df2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:14.100352 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b3baf1fd-611f-477f-91d6-e2fef8629df2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:14.236839 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b3baf1fd-611f-477f-91d6-e2fef8629df2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:14.248122 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b3baf1fd-611f-477f-91d6-e2fef8629df2 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1565 microversion: 2.1 time: 0.162620 May 13 14:57:14.248586 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 185/397] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:14 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:14.264517 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b511d427-520a-417e-ae5c-4a6f8d218572 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:14.264706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f13aafc8-4d59-43d3-b7a8-886ce2b4b57c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:14.265133 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f13aafc8-4d59-43d3-b7a8-886ce2b4b57c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:14.267857 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b511d427-520a-417e-ae5c-4a6f8d218572 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:14.271070 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f13aafc8-4d59-43d3-b7a8-886ce2b4b57c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:14.271732 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f13aafc8-4d59-43d3-b7a8-886ce2b4b57c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:14.272557 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f13aafc8-4d59-43d3-b7a8-886ce2b4b57c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:14.273029 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f13aafc8-4d59-43d3-b7a8-886ce2b4b57c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:14.275102 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b511d427-520a-417e-ae5c-4a6f8d218572 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:14.275595 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b511d427-520a-417e-ae5c-4a6f8d218572 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:14.276630 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b511d427-520a-417e-ae5c-4a6f8d218572 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:14.277103 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b511d427-520a-417e-ae5c-4a6f8d218572 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:14.409513 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f13aafc8-4d59-43d3-b7a8-886ce2b4b57c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148695 May 13 14:57:14.410624 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 213/398] 10.222.0.99 () {58 vars in 1274 bytes} [Fri May 13 14:57:14 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:57:14.456807 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b511d427-520a-417e-ae5c-4a6f8d218572 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:14.464944 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b511d427-520a-417e-ae5c-4a6f8d218572 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1319 microversion: 2.1 time: 0.204428 May 13 14:57:14.466170 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 186/399] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:14 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:15.485253 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-52bd63db-73e7-44ab-bbd6-1594d52a7b68 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:15.487162 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-52bd63db-73e7-44ab-bbd6-1594d52a7b68 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:15.495592 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-52bd63db-73e7-44ab-bbd6-1594d52a7b68 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:15.496824 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-52bd63db-73e7-44ab-bbd6-1594d52a7b68 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:15.498329 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-52bd63db-73e7-44ab-bbd6-1594d52a7b68 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:15.498768 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-52bd63db-73e7-44ab-bbd6-1594d52a7b68 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:15.651941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-52bd63db-73e7-44ab-bbd6-1594d52a7b68 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:15.670627 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-52bd63db-73e7-44ab-bbd6-1594d52a7b68 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1319 microversion: 2.1 time: 0.191674 May 13 14:57:15.682019 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 214/400] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:15 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:15.694320 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-c783c1f7-d594-4913-88c8-39a2ae441b2e req-35b7f7cb-bedf-43d0-9896-a32dd4f87d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15fd606f-6ebc-46d6-9fe8-bd7219c22f27", "tag": "751bef1d-e5f5-41a9-bbf3-44c2a5dc804c"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:15.702664 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-c783c1f7-d594-4913-88c8-39a2ae441b2e req-35b7f7cb-bedf-43d0-9896-a32dd4f87d62 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:15.703071 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-c783c1f7-d594-4913-88c8-39a2ae441b2e req-35b7f7cb-bedf-43d0-9896-a32dd4f87d62 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:15.716249 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-c783c1f7-d594-4913-88c8-39a2ae441b2e req-35b7f7cb-bedf-43d0-9896-a32dd4f87d62 service nova] Creating event network-changed:751bef1d-e5f5-41a9-bbf3-44c2a5dc804c for instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 on hv-cinder-83090 May 13 14:57:15.721556 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-c783c1f7-d594-4913-88c8-39a2ae441b2e req-35b7f7cb-bedf-43d0-9896-a32dd4f87d62 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031723 May 13 14:57:15.722175 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 187/401] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:57:16.689064 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c953cdea-8838-4143-8905-cef07c89074d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:16.690468 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c953cdea-8838-4143-8905-cef07c89074d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:16.697590 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c953cdea-8838-4143-8905-cef07c89074d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:16.698179 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c953cdea-8838-4143-8905-cef07c89074d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:16.699089 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c953cdea-8838-4143-8905-cef07c89074d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:16.699626 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c953cdea-8838-4143-8905-cef07c89074d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:16.846180 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c953cdea-8838-4143-8905-cef07c89074d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:16.855485 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c953cdea-8838-4143-8905-cef07c89074d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1319 microversion: 2.1 time: 0.170279 May 13 14:57:16.856643 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 215/402] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:16 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:17.874274 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-d4d6eef5-38d0-4cca-b028-5e540515795d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:17.874965 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-d4d6eef5-38d0-4cca-b028-5e540515795d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:17.881620 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d4d6eef5-38d0-4cca-b028-5e540515795d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:17.882076 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d4d6eef5-38d0-4cca-b028-5e540515795d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:17.882838 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d4d6eef5-38d0-4cca-b028-5e540515795d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:17.883269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d4d6eef5-38d0-4cca-b028-5e540515795d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:18.017757 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-d4d6eef5-38d0-4cca-b028-5e540515795d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:18.029086 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-d4d6eef5-38d0-4cca-b028-5e540515795d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1319 microversion: 2.1 time: 0.159435 May 13 14:57:18.029867 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 188/403] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:17 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:19.051048 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c4362352-3cf8-4407-84aa-f0bba681d325 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:19.051644 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c4362352-3cf8-4407-84aa-f0bba681d325 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:19.058583 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c4362352-3cf8-4407-84aa-f0bba681d325 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:19.059030 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c4362352-3cf8-4407-84aa-f0bba681d325 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:19.059798 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c4362352-3cf8-4407-84aa-f0bba681d325 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:19.060276 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c4362352-3cf8-4407-84aa-f0bba681d325 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:19.201905 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c4362352-3cf8-4407-84aa-f0bba681d325 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:19.211021 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c4362352-3cf8-4407-84aa-f0bba681d325 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1319 microversion: 2.1 time: 0.164066 May 13 14:57:19.211888 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 216/404] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:19 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:19.292141 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-1d06549c-1986-4270-a6b0-311a232374a1 req-9b4ca17c-d4b9-4b4d-a090-b34e588d847b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa4062d3-a547-4be9-b840-e5f9a4ca1205", "name": "network-vif-plugged", "status": "completed", "tag": "99ba8426-1b1e-44a7-8c7d-58c7127f89ae"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:19.300807 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-1d06549c-1986-4270-a6b0-311a232374a1 req-9b4ca17c-d4b9-4b4d-a090-b34e588d847b service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:19.301583 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-1d06549c-1986-4270-a6b0-311a232374a1 req-9b4ca17c-d4b9-4b4d-a090-b34e588d847b service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:19.316587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-1d06549c-1986-4270-a6b0-311a232374a1 req-9b4ca17c-d4b9-4b4d-a090-b34e588d847b service nova] Creating event network-vif-plugged:99ba8426-1b1e-44a7-8c7d-58c7127f89ae for instance fa4062d3-a547-4be9-b840-e5f9a4ca1205 on hv-cinder-83090 May 13 14:57:19.321731 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-1d06549c-1986-4270-a6b0-311a232374a1 req-9b4ca17c-d4b9-4b4d-a090-b34e588d847b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033319 May 13 14:57:19.322579 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 189/405] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:57:20.233118 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-686ca5f5-c5d3-4c2b-8ad9-d4fabf3f9ecf tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:20.234220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-686ca5f5-c5d3-4c2b-8ad9-d4fabf3f9ecf tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:20.244116 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-686ca5f5-c5d3-4c2b-8ad9-d4fabf3f9ecf tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:20.244863 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-686ca5f5-c5d3-4c2b-8ad9-d4fabf3f9ecf tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:20.246169 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-686ca5f5-c5d3-4c2b-8ad9-d4fabf3f9ecf tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:20.246925 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-686ca5f5-c5d3-4c2b-8ad9-d4fabf3f9ecf tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:20.393643 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-686ca5f5-c5d3-4c2b-8ad9-d4fabf3f9ecf tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:20.401571 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-686ca5f5-c5d3-4c2b-8ad9-d4fabf3f9ecf tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1319 microversion: 2.1 time: 0.175481 May 13 14:57:20.402144 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 217/406] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:20 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:21.420975 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-184f4248-c9be-4f5c-8c61-f35cda097bf7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:21.421826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-184f4248-c9be-4f5c-8c61-f35cda097bf7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:21.429810 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-184f4248-c9be-4f5c-8c61-f35cda097bf7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:21.430251 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-184f4248-c9be-4f5c-8c61-f35cda097bf7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:21.431016 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-184f4248-c9be-4f5c-8c61-f35cda097bf7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:21.431448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-184f4248-c9be-4f5c-8c61-f35cda097bf7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:21.575904 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-184f4248-c9be-4f5c-8c61-f35cda097bf7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:21.583885 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-184f4248-c9be-4f5c-8c61-f35cda097bf7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1319 microversion: 2.1 time: 0.168096 May 13 14:57:21.584569 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 190/407] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:21 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:22.470810 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-48dd60b2-ef8b-402c-ae47-34e00058bf85 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:22.472177 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-48dd60b2-ef8b-402c-ae47-34e00058bf85 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:22.478368 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-48dd60b2-ef8b-402c-ae47-34e00058bf85 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:22.478814 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-48dd60b2-ef8b-402c-ae47-34e00058bf85 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:22.479600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-48dd60b2-ef8b-402c-ae47-34e00058bf85 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:22.480442 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-48dd60b2-ef8b-402c-ae47-34e00058bf85 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:22.505150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-48dd60b2-ef8b-402c-ae47-34e00058bf85 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/ips" status: 200 len: 152 microversion: 2.20 time: 0.039524 May 13 14:57:22.505637 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 218/408] 10.222.0.99 () {60 vars in 1288 bytes} [Fri May 13 14:57:22 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:57:22.601420 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-59529c44-5b2e-4d07-a4c4-2438f9d9b6ed tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:22.602024 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-59529c44-5b2e-4d07-a4c4-2438f9d9b6ed tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:22.608848 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-59529c44-5b2e-4d07-a4c4-2438f9d9b6ed tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:22.609298 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-59529c44-5b2e-4d07-a4c4-2438f9d9b6ed tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:22.610155 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-59529c44-5b2e-4d07-a4c4-2438f9d9b6ed tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:22.610509 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-59529c44-5b2e-4d07-a4c4-2438f9d9b6ed tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:22.743781 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-59529c44-5b2e-4d07-a4c4-2438f9d9b6ed tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:22.752396 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-59529c44-5b2e-4d07-a4c4-2438f9d9b6ed tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1508 microversion: 2.1 time: 0.154883 May 13 14:57:22.752972 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 191/409] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:22 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:25.304302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-58ccbd79-ddba-48e8-9c6b-9efe54bd17a7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:25.304981 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-58ccbd79-ddba-48e8-9c6b-9efe54bd17a7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:25.311216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-58ccbd79-ddba-48e8-9c6b-9efe54bd17a7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:25.311647 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-58ccbd79-ddba-48e8-9c6b-9efe54bd17a7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:25.312469 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-58ccbd79-ddba-48e8-9c6b-9efe54bd17a7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:25.312898 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-58ccbd79-ddba-48e8-9c6b-9efe54bd17a7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:25.336529 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-58ccbd79-ddba-48e8-9c6b-9efe54bd17a7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lazy-loading 'flavor' on Instance uuid 96db69fe-6594-486c-96b3-545e6dbfa29b {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:57:25.616093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-58ccbd79-ddba-48e8-9c6b-9efe54bd17a7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "POST /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/action" status: 202 len: 0 microversion: 2.20 time: 0.315566 May 13 14:57:25.616886 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 219/410] 10.222.0.99 () {62 vars in 1318 bytes} [Fri May 13 14:57:25 2022] POST /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 14:57:25.626100 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8a698d68-9c75-4710-9ba5-c1fb1f285897 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:25.626761 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8a698d68-9c75-4710-9ba5-c1fb1f285897 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:25.633332 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8a698d68-9c75-4710-9ba5-c1fb1f285897 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:25.633791 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8a698d68-9c75-4710-9ba5-c1fb1f285897 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:25.634677 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8a698d68-9c75-4710-9ba5-c1fb1f285897 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:25.635112 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8a698d68-9c75-4710-9ba5-c1fb1f285897 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:25.770012 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8a698d68-9c75-4710-9ba5-c1fb1f285897 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:25.778534 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8a698d68-9c75-4710-9ba5-c1fb1f285897 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:25.780035 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8a698d68-9c75-4710-9ba5-c1fb1f285897 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:25.781206 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8a698d68-9c75-4710-9ba5-c1fb1f285897 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.159845 May 13 14:57:25.781780 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 192/411] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:25 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:25.915036 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-456b6dad-6a9c-4fda-ae55-c4b06677327a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:25.915795 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-456b6dad-6a9c-4fda-ae55-c4b06677327a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:25.923130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-456b6dad-6a9c-4fda-ae55-c4b06677327a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:25.923575 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-456b6dad-6a9c-4fda-ae55-c4b06677327a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:25.924414 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-456b6dad-6a9c-4fda-ae55-c4b06677327a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:25.924880 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-456b6dad-6a9c-4fda-ae55-c4b06677327a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:25.950493 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-456b6dad-6a9c-4fda-ae55-c4b06677327a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7/ips" status: 200 len: 150 microversion: 2.1 time: 0.039665 May 13 14:57:25.951073 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 220/412] 10.222.0.99 () {58 vars in 1247 bytes} [Fri May 13 14:57:25 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:57:26.488953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7e139024-563a-49a8-bdd5-38c63836eb50 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:26.489442 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7e139024-563a-49a8-bdd5-38c63836eb50 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:26.496197 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7e139024-563a-49a8-bdd5-38c63836eb50 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:26.496648 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7e139024-563a-49a8-bdd5-38c63836eb50 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:26.497424 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7e139024-563a-49a8-bdd5-38c63836eb50 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:26.497859 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7e139024-563a-49a8-bdd5-38c63836eb50 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:26.522896 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7e139024-563a-49a8-bdd5-38c63836eb50 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/ips" status: 200 len: 143 microversion: 2.1 time: 0.037786 May 13 14:57:26.523494 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 193/413] 10.222.0.99 () {58 vars in 1247 bytes} [Fri May 13 14:57:26 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/ips => generated 143 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:57:26.804101 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e78e7858-ab27-4715-b383-693aa9338c15 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:26.805071 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e78e7858-ab27-4715-b383-693aa9338c15 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:26.815456 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e78e7858-ab27-4715-b383-693aa9338c15 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:26.816267 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e78e7858-ab27-4715-b383-693aa9338c15 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:26.817545 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e78e7858-ab27-4715-b383-693aa9338c15 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:26.818246 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e78e7858-ab27-4715-b383-693aa9338c15 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:26.962548 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e78e7858-ab27-4715-b383-693aa9338c15 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:26.970598 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e78e7858-ab27-4715-b383-693aa9338c15 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:26.972112 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e78e7858-ab27-4715-b383-693aa9338c15 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:26.973283 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e78e7858-ab27-4715-b383-693aa9338c15 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.175849 May 13 14:57:26.973848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 221/414] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:26 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:27.992949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b40cb80a-287c-4725-997d-0f00d37f3b18 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:27.993546 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b40cb80a-287c-4725-997d-0f00d37f3b18 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:28.000278 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b40cb80a-287c-4725-997d-0f00d37f3b18 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:28.000704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b40cb80a-287c-4725-997d-0f00d37f3b18 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:28.001481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b40cb80a-287c-4725-997d-0f00d37f3b18 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:28.001912 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b40cb80a-287c-4725-997d-0f00d37f3b18 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:28.148598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b40cb80a-287c-4725-997d-0f00d37f3b18 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:28.157596 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b40cb80a-287c-4725-997d-0f00d37f3b18 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:28.159006 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b40cb80a-287c-4725-997d-0f00d37f3b18 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:28.160396 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b40cb80a-287c-4725-997d-0f00d37f3b18 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.171414 May 13 14:57:28.161181 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 194/415] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:27 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:28.378280 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-0d18979d-23eb-44d7-a81b-81f5aa0aa100 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "864e8c99-20e3-4664-80b2-be57402af2f9"}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:28.379407 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-0d18979d-23eb-44d7-a81b-81f5aa0aa100 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:28.385390 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0d18979d-23eb-44d7-a81b-81f5aa0aa100 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:28.385838 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0d18979d-23eb-44d7-a81b-81f5aa0aa100 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:28.386614 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0d18979d-23eb-44d7-a81b-81f5aa0aa100 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:28.387041 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0d18979d-23eb-44d7-a81b-81f5aa0aa100 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:28.654691 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:57:28.655330 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Fri May 13 14:57:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:57:28.720677 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-0d18979d-23eb-44d7-a81b-81f5aa0aa100 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "POST /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346178 May 13 14:57:28.721754 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 222/416] 10.222.0.99 () {60 vars in 1322 bytes} [Fri May 13 14:57:28 2022] POST /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:57:29.183676 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ffb99a39-4dd2-4c82-8bfc-f7fedcfce212 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:29.184275 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ffb99a39-4dd2-4c82-8bfc-f7fedcfce212 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:29.191831 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ffb99a39-4dd2-4c82-8bfc-f7fedcfce212 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:29.192381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ffb99a39-4dd2-4c82-8bfc-f7fedcfce212 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:29.193163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ffb99a39-4dd2-4c82-8bfc-f7fedcfce212 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:29.193618 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ffb99a39-4dd2-4c82-8bfc-f7fedcfce212 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:29.282590 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3dc526d6-6129-4c8a-8bf6-495f20bcab1f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "063d8258-1558-4c9b-af0c-fdacbe680d9e"}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:29.283812 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3dc526d6-6129-4c8a-8bf6-495f20bcab1f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:29.292256 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3dc526d6-6129-4c8a-8bf6-495f20bcab1f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:29.292716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3dc526d6-6129-4c8a-8bf6-495f20bcab1f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:29.293481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3dc526d6-6129-4c8a-8bf6-495f20bcab1f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:29.293913 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3dc526d6-6129-4c8a-8bf6-495f20bcab1f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:29.328015 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ffb99a39-4dd2-4c82-8bfc-f7fedcfce212 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:29.336947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ffb99a39-4dd2-4c82-8bfc-f7fedcfce212 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:29.338519 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ffb99a39-4dd2-4c82-8bfc-f7fedcfce212 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:29.339863 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ffb99a39-4dd2-4c82-8bfc-f7fedcfce212 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.162122 May 13 14:57:29.340522 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 195/417] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:29 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:57:29.639307 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3dc526d6-6129-4c8a-8bf6-495f20bcab1f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "POST /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361660 May 13 14:57:29.639926 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 223/418] 10.222.0.99 () {60 vars in 1322 bytes} [Fri May 13 14:57:29 2022] POST /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:57:30.359289 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3a704789-688c-4a27-b8c2-6c9f6cf186ac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:30.359857 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-3a704789-688c-4a27-b8c2-6c9f6cf186ac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:30.366471 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a704789-688c-4a27-b8c2-6c9f6cf186ac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:30.366921 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a704789-688c-4a27-b8c2-6c9f6cf186ac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:30.367690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a704789-688c-4a27-b8c2-6c9f6cf186ac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:30.368182 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a704789-688c-4a27-b8c2-6c9f6cf186ac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:30.512326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3a704789-688c-4a27-b8c2-6c9f6cf186ac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:30.522631 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3a704789-688c-4a27-b8c2-6c9f6cf186ac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:30.524175 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3a704789-688c-4a27-b8c2-6c9f6cf186ac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:30.525343 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-3a704789-688c-4a27-b8c2-6c9f6cf186ac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.170643 May 13 14:57:30.525886 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 196/419] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:30 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:31.549429 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d89d7aef-0f37-4222-832e-78cfe798d3b1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:31.550223 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d89d7aef-0f37-4222-832e-78cfe798d3b1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:31.558209 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d89d7aef-0f37-4222-832e-78cfe798d3b1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:31.558660 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d89d7aef-0f37-4222-832e-78cfe798d3b1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:31.559438 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d89d7aef-0f37-4222-832e-78cfe798d3b1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:31.559899 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d89d7aef-0f37-4222-832e-78cfe798d3b1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:31.697943 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d89d7aef-0f37-4222-832e-78cfe798d3b1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:31.706580 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d89d7aef-0f37-4222-832e-78cfe798d3b1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:31.708113 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d89d7aef-0f37-4222-832e-78cfe798d3b1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:31.709340 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d89d7aef-0f37-4222-832e-78cfe798d3b1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.167754 May 13 14:57:31.710121 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 224/420] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:31 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:32.731674 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6c75f791-2eb5-4650-966e-a12962e1213f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:32.732717 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6c75f791-2eb5-4650-966e-a12962e1213f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:32.742965 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6c75f791-2eb5-4650-966e-a12962e1213f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:32.743700 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6c75f791-2eb5-4650-966e-a12962e1213f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:32.744932 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6c75f791-2eb5-4650-966e-a12962e1213f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:32.745599 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6c75f791-2eb5-4650-966e-a12962e1213f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:32.893330 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6c75f791-2eb5-4650-966e-a12962e1213f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:32.901595 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6c75f791-2eb5-4650-966e-a12962e1213f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:32.903092 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6c75f791-2eb5-4650-966e-a12962e1213f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:32.904287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6c75f791-2eb5-4650-966e-a12962e1213f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.178987 May 13 14:57:32.904851 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 197/421] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:32 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:33.922962 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d0ddab35-7248-4925-8620-4f8591c2a03b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:33.923555 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d0ddab35-7248-4925-8620-4f8591c2a03b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:33.930773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d0ddab35-7248-4925-8620-4f8591c2a03b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:33.931270 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d0ddab35-7248-4925-8620-4f8591c2a03b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:33.932092 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d0ddab35-7248-4925-8620-4f8591c2a03b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:33.932525 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d0ddab35-7248-4925-8620-4f8591c2a03b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:34.066782 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d0ddab35-7248-4925-8620-4f8591c2a03b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:34.074808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d0ddab35-7248-4925-8620-4f8591c2a03b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:34.076360 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d0ddab35-7248-4925-8620-4f8591c2a03b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:34.077556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d0ddab35-7248-4925-8620-4f8591c2a03b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.158831 May 13 14:57:34.078289 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 225/422] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:33 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:35.095523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-33e98101-29e1-41f2-83d8-144555ab2286 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:35.096117 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-33e98101-29e1-41f2-83d8-144555ab2286 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:35.103430 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-33e98101-29e1-41f2-83d8-144555ab2286 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:35.104194 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-33e98101-29e1-41f2-83d8-144555ab2286 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:35.105594 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-33e98101-29e1-41f2-83d8-144555ab2286 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:35.106114 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-33e98101-29e1-41f2-83d8-144555ab2286 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:35.248192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-33e98101-29e1-41f2-83d8-144555ab2286 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:35.256732 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-33e98101-29e1-41f2-83d8-144555ab2286 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:35.258212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-33e98101-29e1-41f2-83d8-144555ab2286 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:35.259363 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-33e98101-29e1-41f2-83d8-144555ab2286 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.167840 May 13 14:57:35.259929 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 198/423] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:35 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:36.279358 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-b945d072-829e-401e-8daf-49ecc5784491 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:36.280006 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-b945d072-829e-401e-8daf-49ecc5784491 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:36.287305 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b945d072-829e-401e-8daf-49ecc5784491 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:36.287702 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b945d072-829e-401e-8daf-49ecc5784491 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:36.288931 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b945d072-829e-401e-8daf-49ecc5784491 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:36.289374 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b945d072-829e-401e-8daf-49ecc5784491 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:36.678451 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b945d072-829e-401e-8daf-49ecc5784491 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:36.686980 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b945d072-829e-401e-8daf-49ecc5784491 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:36.688497 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b945d072-829e-401e-8daf-49ecc5784491 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:36.689688 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-b945d072-829e-401e-8daf-49ecc5784491 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.414570 May 13 14:57:36.690239 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 226/424] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:36 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:37.306659 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5538a3dc-1909-42e7-9abc-c68e6fc83b0c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Action: 'create', calling method: .version_select at 0x7fcf483284c0>, body: {"keypair": {"name": "tempest-keypair-1824062944", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLD9toB7o23DzUpgVQ0BrSE25oizmt2QrrMUHUGzA1yw5G5QU72hYiC6a16t64FGXFG83DlGtIgYzJpIK3zW5D209DOqYPFRn82MOCkoUg35XvziD1XN2WyO9Y8Yd/OnDw=="}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:37.321950 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-5538a3dc-1909-42e7-9abc-c68e6fc83b0c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Getting quotas for project 8ff6bdb0a99948698dc413c12b120b61. Resources: {'key_pairs'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:57:37.326533 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-5538a3dc-1909-42e7-9abc-c68e6fc83b0c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Getting quotas for user 1ded6e90b10949dcb921119073f2d26a and project 8ff6bdb0a99948698dc413c12b120b61. Resources: {'key_pairs'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:57:37.358742 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5538a3dc-1909-42e7-9abc-c68e6fc83b0c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056042 May 13 14:57:37.359359 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 199/425] 10.222.0.99 () {60 vars in 1158 bytes} [Fri May 13 14:57:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:57:37.714852 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-82c6e2e9-91ca-4f81-b57a-efd44018d17e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:37.715555 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-82c6e2e9-91ca-4f81-b57a-efd44018d17e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:37.723681 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-82c6e2e9-91ca-4f81-b57a-efd44018d17e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:37.724156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-82c6e2e9-91ca-4f81-b57a-efd44018d17e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:37.724956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-82c6e2e9-91ca-4f81-b57a-efd44018d17e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:37.725474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-82c6e2e9-91ca-4f81-b57a-efd44018d17e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:37.861249 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-82c6e2e9-91ca-4f81-b57a-efd44018d17e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:37.869595 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-82c6e2e9-91ca-4f81-b57a-efd44018d17e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:37.871064 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-82c6e2e9-91ca-4f81-b57a-efd44018d17e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:37.872280 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-82c6e2e9-91ca-4f81-b57a-efd44018d17e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.162471 May 13 14:57:37.872804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 227/426] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:37 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:38.695939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-97cd4aed-000b-4c57-884b-83498f792a01 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-621944492", "imageRef": "eac0bc7b-d963-4624-aba3-a81fd1bf324c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "316a8fad-500e-494b-ad63-b6f37981c2d9"}], "security_groups": [{"name": "tempest-securitygroup--33853104"}], "key_name": "tempest-keypair-1824062944", "user_data": "}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:38.801419 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.network.neutron [None req-97cd4aed-000b-4c57-884b-83498f792a01 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] validate_networks() for [('316a8fad-500e-494b-ad63-b6f37981c2d9', None, None, None, None, None)] {{(pid=117296) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:57:38.890769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-6d782430-29a7-40c9-800a-83c2baa9ce65 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:38.891397 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-6d782430-29a7-40c9-800a-83c2baa9ce65 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:38.898282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6d782430-29a7-40c9-800a-83c2baa9ce65 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:38.898736 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6d782430-29a7-40c9-800a-83c2baa9ce65 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:38.899515 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6d782430-29a7-40c9-800a-83c2baa9ce65 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:38.899942 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6d782430-29a7-40c9-800a-83c2baa9ce65 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:39.117217 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-6d782430-29a7-40c9-800a-83c2baa9ce65 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:39.125775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-6d782430-29a7-40c9-800a-83c2baa9ce65 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:39.127248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-6d782430-29a7-40c9-800a-83c2baa9ce65 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:39.128451 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-6d782430-29a7-40c9-800a-83c2baa9ce65 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.241613 May 13 14:57:39.129112 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 228/427] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:38 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:39.244854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-97cd4aed-000b-4c57-884b-83498f792a01 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Flavor limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:57:39.245277 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-97cd4aed-000b-4c57-884b-83498f792a01 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Image limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:57:39.245745 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-97cd4aed-000b-4c57-884b-83498f792a01 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Flavor pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:57:39.246153 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-97cd4aed-000b-4c57-884b-83498f792a01 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Image pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:57:39.246558 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-97cd4aed-000b-4c57-884b-83498f792a01 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:57:39.256247 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-97cd4aed-000b-4c57-884b-83498f792a01 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:39.256738 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-97cd4aed-000b-4c57-884b-83498f792a01 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:39.257734 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-97cd4aed-000b-4c57-884b-83498f792a01 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:39.258167 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-97cd4aed-000b-4c57-884b-83498f792a01 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:39.278706 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-97cd4aed-000b-4c57-884b-83498f792a01 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Getting quotas for project 8ff6bdb0a99948698dc413c12b120b61. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:57:39.284810 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-97cd4aed-000b-4c57-884b-83498f792a01 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Getting quotas for user 1ded6e90b10949dcb921119073f2d26a and project 8ff6bdb0a99948698dc413c12b120b61. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:57:39.298195 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-97cd4aed-000b-4c57-884b-83498f792a01 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Going to run 1 instances... {{(pid=117296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:57:39.300463 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-97cd4aed-000b-4c57-884b-83498f792a01 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac0bc7b-d963-4624-aba3-a81fd1bf324c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:57:39.364457 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-97cd4aed-000b-4c57-884b-83498f792a01 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.673650 May 13 14:57:39.365126 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 200/428] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 14:57:38 2022] POST /compute/v2.1/servers => generated 400 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:57:39.376098 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-bbf44634-b06b-44f5-bc68-70b79e83881c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:39.376802 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-bbf44634-b06b-44f5-bc68-70b79e83881c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:39.435774 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-bbf44634-b06b-44f5-bc68-70b79e83881c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:39.444717 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-bbf44634-b06b-44f5-bc68-70b79e83881c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1241 microversion: 2.1 time: 0.072375 May 13 14:57:39.445295 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 229/429] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:39 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:40.150724 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8ef981b4-be54-474e-b1df-b06f5be04c9e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:40.151315 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8ef981b4-be54-474e-b1df-b06f5be04c9e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:40.158545 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8ef981b4-be54-474e-b1df-b06f5be04c9e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:40.158991 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8ef981b4-be54-474e-b1df-b06f5be04c9e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:40.159763 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8ef981b4-be54-474e-b1df-b06f5be04c9e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:40.160232 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8ef981b4-be54-474e-b1df-b06f5be04c9e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:40.296949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8ef981b4-be54-474e-b1df-b06f5be04c9e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:40.305418 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8ef981b4-be54-474e-b1df-b06f5be04c9e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:40.306924 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8ef981b4-be54-474e-b1df-b06f5be04c9e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:40.308151 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8ef981b4-be54-474e-b1df-b06f5be04c9e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.162594 May 13 14:57:40.308838 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 201/430] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:40 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:40.463427 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-8c786850-c7c3-43f0-a0f9-175d62ab5da3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:40.464085 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-8c786850-c7c3-43f0-a0f9-175d62ab5da3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:40.471327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8c786850-c7c3-43f0-a0f9-175d62ab5da3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:40.471781 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8c786850-c7c3-43f0-a0f9-175d62ab5da3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:40.472599 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8c786850-c7c3-43f0-a0f9-175d62ab5da3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:40.473700 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8c786850-c7c3-43f0-a0f9-175d62ab5da3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:40.537057 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-8c786850-c7c3-43f0-a0f9-175d62ab5da3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:40.545024 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-8c786850-c7c3-43f0-a0f9-175d62ab5da3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1293 microversion: 2.1 time: 0.086986 May 13 14:57:40.545578 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 230/431] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:40 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:41.327236 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7050958e-e149-47bd-b976-a39164680b73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:41.327887 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7050958e-e149-47bd-b976-a39164680b73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:41.334763 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7050958e-e149-47bd-b976-a39164680b73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:41.335194 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7050958e-e149-47bd-b976-a39164680b73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:41.335980 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7050958e-e149-47bd-b976-a39164680b73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:41.336415 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7050958e-e149-47bd-b976-a39164680b73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:41.469693 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7050958e-e149-47bd-b976-a39164680b73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:41.478317 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7050958e-e149-47bd-b976-a39164680b73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:41.480229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7050958e-e149-47bd-b976-a39164680b73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:41.481739 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7050958e-e149-47bd-b976-a39164680b73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.158815 May 13 14:57:41.492461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 202/432] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:41 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:41.562660 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-40b6733b-0454-4bfc-856d-9193efddd009 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:41.564025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-40b6733b-0454-4bfc-856d-9193efddd009 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:41.570559 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-40b6733b-0454-4bfc-856d-9193efddd009 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:41.571136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-40b6733b-0454-4bfc-856d-9193efddd009 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:41.572082 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-40b6733b-0454-4bfc-856d-9193efddd009 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:41.572518 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-40b6733b-0454-4bfc-856d-9193efddd009 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:41.637372 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-40b6733b-0454-4bfc-856d-9193efddd009 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:41.644897 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-40b6733b-0454-4bfc-856d-9193efddd009 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1299 microversion: 2.1 time: 0.086136 May 13 14:57:41.645451 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 231/433] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:41 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:42.491975 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-bd2100f9-c3e8-4512-8adc-9c5972b45184 req-876223ea-8d9f-43db-b515-61b48f4cf8cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea83690-7cf5-475e-9339-4bf228b48893", "tag": "05c9f616-6d8a-443a-adf5-507c9b933e77"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:42.500412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-5d584294-bfdb-4b38-b626-bd9498d1ba83 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:42.501157 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-5d584294-bfdb-4b38-b626-bd9498d1ba83 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:42.503768 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-bd2100f9-c3e8-4512-8adc-9c5972b45184 req-876223ea-8d9f-43db-b515-61b48f4cf8cb service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:42.505371 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-bd2100f9-c3e8-4512-8adc-9c5972b45184 req-876223ea-8d9f-43db-b515-61b48f4cf8cb service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:42.514673 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5d584294-bfdb-4b38-b626-bd9498d1ba83 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:42.515224 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5d584294-bfdb-4b38-b626-bd9498d1ba83 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:42.516125 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5d584294-bfdb-4b38-b626-bd9498d1ba83 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:42.516712 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5d584294-bfdb-4b38-b626-bd9498d1ba83 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:42.525012 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-bd2100f9-c3e8-4512-8adc-9c5972b45184 req-876223ea-8d9f-43db-b515-61b48f4cf8cb service nova] Creating event network-changed:05c9f616-6d8a-443a-adf5-507c9b933e77 for instance 8ea83690-7cf5-475e-9339-4bf228b48893 on hv-cinder-83090 May 13 14:57:42.537449 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-bd2100f9-c3e8-4512-8adc-9c5972b45184 req-876223ea-8d9f-43db-b515-61b48f4cf8cb service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048926 May 13 14:57:42.540028 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 203/434] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:57:42.658478 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-5d584294-bfdb-4b38-b626-bd9498d1ba83 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:42.663177 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-70671320-6347-4096-b2f4-febbbae3817e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:42.664176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-70671320-6347-4096-b2f4-febbbae3817e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:42.667976 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-5d584294-bfdb-4b38-b626-bd9498d1ba83 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:42.669465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-5d584294-bfdb-4b38-b626-bd9498d1ba83 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:42.670635 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-5d584294-bfdb-4b38-b626-bd9498d1ba83 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.174228 May 13 14:57:42.671368 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 232/435] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:42 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:42.674313 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-70671320-6347-4096-b2f4-febbbae3817e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:42.674790 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-70671320-6347-4096-b2f4-febbbae3817e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:42.675585 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-70671320-6347-4096-b2f4-febbbae3817e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:42.676205 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-70671320-6347-4096-b2f4-febbbae3817e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:42.804037 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-70671320-6347-4096-b2f4-febbbae3817e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:42.811922 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-70671320-6347-4096-b2f4-febbbae3817e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1365 microversion: 2.1 time: 0.153430 May 13 14:57:42.812503 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 204/436] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:42 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:57:43.692831 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9995ca1a-4a50-4d74-9c03-2fca69145512 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:43.693688 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9995ca1a-4a50-4d74-9c03-2fca69145512 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:43.702136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9995ca1a-4a50-4d74-9c03-2fca69145512 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:43.702583 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9995ca1a-4a50-4d74-9c03-2fca69145512 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:43.703365 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9995ca1a-4a50-4d74-9c03-2fca69145512 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:43.703797 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9995ca1a-4a50-4d74-9c03-2fca69145512 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:43.832377 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-811be5a6-c45a-43ce-8d90-8d76940a360f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:43.832977 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-811be5a6-c45a-43ce-8d90-8d76940a360f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:43.839553 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-811be5a6-c45a-43ce-8d90-8d76940a360f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:43.840037 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-811be5a6-c45a-43ce-8d90-8d76940a360f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:43.840842 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-811be5a6-c45a-43ce-8d90-8d76940a360f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:43.841283 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-811be5a6-c45a-43ce-8d90-8d76940a360f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:43.850135 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9995ca1a-4a50-4d74-9c03-2fca69145512 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:43.858795 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9995ca1a-4a50-4d74-9c03-2fca69145512 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:43.860308 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9995ca1a-4a50-4d74-9c03-2fca69145512 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:43.861462 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9995ca1a-4a50-4d74-9c03-2fca69145512 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.175451 May 13 14:57:43.862018 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 233/437] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:43 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:43.994062 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-811be5a6-c45a-43ce-8d90-8d76940a360f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:44.001626 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-811be5a6-c45a-43ce-8d90-8d76940a360f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1365 microversion: 2.1 time: 0.173108 May 13 14:57:44.002197 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 205/438] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:43 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:44.880407 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-613d1e04-6e2a-4744-9358-53fb220f701d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:44.881023 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-613d1e04-6e2a-4744-9358-53fb220f701d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:44.890036 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-613d1e04-6e2a-4744-9358-53fb220f701d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:44.890790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-613d1e04-6e2a-4744-9358-53fb220f701d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:44.892162 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-613d1e04-6e2a-4744-9358-53fb220f701d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:44.892896 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-613d1e04-6e2a-4744-9358-53fb220f701d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:45.018945 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6976dc93-d9bc-4b99-894a-aac2e76f98e4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:45.019499 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6976dc93-d9bc-4b99-894a-aac2e76f98e4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:45.026128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6976dc93-d9bc-4b99-894a-aac2e76f98e4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:45.026580 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6976dc93-d9bc-4b99-894a-aac2e76f98e4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:45.027346 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6976dc93-d9bc-4b99-894a-aac2e76f98e4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:45.027820 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6976dc93-d9bc-4b99-894a-aac2e76f98e4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:45.048582 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-613d1e04-6e2a-4744-9358-53fb220f701d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:45.056515 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-613d1e04-6e2a-4744-9358-53fb220f701d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:45.058058 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-613d1e04-6e2a-4744-9358-53fb220f701d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:45.059303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-613d1e04-6e2a-4744-9358-53fb220f701d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.182933 May 13 14:57:45.059854 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 234/439] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:44 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:45.170812 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6976dc93-d9bc-4b99-894a-aac2e76f98e4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:45.179122 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6976dc93-d9bc-4b99-894a-aac2e76f98e4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1365 microversion: 2.1 time: 0.164106 May 13 14:57:45.179697 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 206/440] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:45 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:46.078420 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e03bcf09-926c-4394-a611-310ddae08e69 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:46.079150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e03bcf09-926c-4394-a611-310ddae08e69 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:46.085622 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e03bcf09-926c-4394-a611-310ddae08e69 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:46.086065 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e03bcf09-926c-4394-a611-310ddae08e69 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:46.086835 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e03bcf09-926c-4394-a611-310ddae08e69 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:46.087267 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e03bcf09-926c-4394-a611-310ddae08e69 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:46.196312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8efcf89b-0d68-42c9-8e55-8adde238e497 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:46.196865 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8efcf89b-0d68-42c9-8e55-8adde238e497 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:46.203742 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8efcf89b-0d68-42c9-8e55-8adde238e497 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:46.204220 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8efcf89b-0d68-42c9-8e55-8adde238e497 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:46.205043 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8efcf89b-0d68-42c9-8e55-8adde238e497 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:46.205477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8efcf89b-0d68-42c9-8e55-8adde238e497 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:46.220458 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e03bcf09-926c-4394-a611-310ddae08e69 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:46.228497 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e03bcf09-926c-4394-a611-310ddae08e69 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:46.229993 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e03bcf09-926c-4394-a611-310ddae08e69 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:46.231767 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e03bcf09-926c-4394-a611-310ddae08e69 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1744 microversion: 2.20 time: 0.157949 May 13 14:57:46.232362 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 235/441] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:46 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:46.338107 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8efcf89b-0d68-42c9-8e55-8adde238e497 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:46.345951 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8efcf89b-0d68-42c9-8e55-8adde238e497 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1365 microversion: 2.1 time: 0.153495 May 13 14:57:46.346485 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 207/442] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:46 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:46.683369 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-940b96bc-3fcb-4015-9731-d3589d547199 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:46.689897 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-940b96bc-3fcb-4015-9731-d3589d547199 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:46.690335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-940b96bc-3fcb-4015-9731-d3589d547199 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:46.748500 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-940b96bc-3fcb-4015-9731-d3589d547199 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Going to try to stop instance {{(pid=117295) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 13 14:57:46.796730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-940b96bc-3fcb-4015-9731-d3589d547199 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "POST /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/action" status: 202 len: 0 microversion: 2.1 time: 0.117041 May 13 14:57:46.797314 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 236/443] 10.222.0.99 () {60 vars in 1277 bytes} [Fri May 13 14:57:46 2022] POST /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:57:46.805602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a9405738-8329-4b6d-9dbc-d4275a0bf9ff tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:46.806249 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a9405738-8329-4b6d-9dbc-d4275a0bf9ff tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:46.814793 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a9405738-8329-4b6d-9dbc-d4275a0bf9ff tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:46.815409 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a9405738-8329-4b6d-9dbc-d4275a0bf9ff tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:46.816604 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a9405738-8329-4b6d-9dbc-d4275a0bf9ff tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:46.817117 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a9405738-8329-4b6d-9dbc-d4275a0bf9ff tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:46.956037 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-a9405738-8329-4b6d-9dbc-d4275a0bf9ff tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:46.966870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a9405738-8329-4b6d-9dbc-d4275a0bf9ff tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.165056 May 13 14:57:46.967656 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 208/444] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:46 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:47.251859 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-dd5c568d-56bc-4672-83ca-44d48bb0d2c8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:47.253224 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-dd5c568d-56bc-4672-83ca-44d48bb0d2c8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:47.259892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dd5c568d-56bc-4672-83ca-44d48bb0d2c8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:47.260355 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dd5c568d-56bc-4672-83ca-44d48bb0d2c8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:47.261135 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dd5c568d-56bc-4672-83ca-44d48bb0d2c8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:47.261565 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dd5c568d-56bc-4672-83ca-44d48bb0d2c8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:47.369498 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-625573c5-15c8-4951-8535-aa8bf3b9472d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:47.370403 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-625573c5-15c8-4951-8535-aa8bf3b9472d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:47.377370 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-625573c5-15c8-4951-8535-aa8bf3b9472d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:47.377520 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-625573c5-15c8-4951-8535-aa8bf3b9472d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:47.378199 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-625573c5-15c8-4951-8535-aa8bf3b9472d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:47.378638 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-625573c5-15c8-4951-8535-aa8bf3b9472d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:47.409045 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-dd5c568d-56bc-4672-83ca-44d48bb0d2c8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:47.417380 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-dd5c568d-56bc-4672-83ca-44d48bb0d2c8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:47.419080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-dd5c568d-56bc-4672-83ca-44d48bb0d2c8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:47.420750 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-dd5c568d-56bc-4672-83ca-44d48bb0d2c8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1744 microversion: 2.20 time: 0.173916 May 13 14:57:47.422112 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 237/445] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:47 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:47.511894 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-625573c5-15c8-4951-8535-aa8bf3b9472d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:47.519700 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-625573c5-15c8-4951-8535-aa8bf3b9472d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1365 microversion: 2.1 time: 0.155664 May 13 14:57:47.520350 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 209/446] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:47 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:47.990219 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ff4d2657-2711-47e6-98f2-dd7a93328809 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:47.991213 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ff4d2657-2711-47e6-98f2-dd7a93328809 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:48.000438 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ff4d2657-2711-47e6-98f2-dd7a93328809 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:48.000886 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ff4d2657-2711-47e6-98f2-dd7a93328809 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:48.001674 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ff4d2657-2711-47e6-98f2-dd7a93328809 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:48.002111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ff4d2657-2711-47e6-98f2-dd7a93328809 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:48.144912 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ff4d2657-2711-47e6-98f2-dd7a93328809 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:48.152821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ff4d2657-2711-47e6-98f2-dd7a93328809 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.169059 May 13 14:57:48.153479 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 238/447] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:47 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:48.438827 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7218d621-d045-42d4-aa37-34620c0a7073 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:48.439518 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7218d621-d045-42d4-aa37-34620c0a7073 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:48.446227 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7218d621-d045-42d4-aa37-34620c0a7073 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:48.446667 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7218d621-d045-42d4-aa37-34620c0a7073 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:48.447441 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7218d621-d045-42d4-aa37-34620c0a7073 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:48.447840 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7218d621-d045-42d4-aa37-34620c0a7073 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:48.536266 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9250fadf-4955-47da-bc96-5c3bddaefd4f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:48.536881 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9250fadf-4955-47da-bc96-5c3bddaefd4f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:48.543398 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9250fadf-4955-47da-bc96-5c3bddaefd4f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:48.543995 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9250fadf-4955-47da-bc96-5c3bddaefd4f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:48.544776 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9250fadf-4955-47da-bc96-5c3bddaefd4f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:48.545207 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9250fadf-4955-47da-bc96-5c3bddaefd4f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:48.581711 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7218d621-d045-42d4-aa37-34620c0a7073 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:48.589698 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7218d621-d045-42d4-aa37-34620c0a7073 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:48.591188 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7218d621-d045-42d4-aa37-34620c0a7073 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:48.592413 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7218d621-d045-42d4-aa37-34620c0a7073 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1744 microversion: 2.20 time: 0.157614 May 13 14:57:48.592976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 210/448] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:48 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:48.684696 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9250fadf-4955-47da-bc96-5c3bddaefd4f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:48.692449 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9250fadf-4955-47da-bc96-5c3bddaefd4f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1365 microversion: 2.1 time: 0.159992 May 13 14:57:48.693018 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 239/449] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:48 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:57:49.173907 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-86bb64f9-a3cf-40b9-b273-341cfdf63c1d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:49.174514 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-86bb64f9-a3cf-40b9-b273-341cfdf63c1d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:49.180989 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-86bb64f9-a3cf-40b9-b273-341cfdf63c1d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:49.181437 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-86bb64f9-a3cf-40b9-b273-341cfdf63c1d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:49.182201 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-86bb64f9-a3cf-40b9-b273-341cfdf63c1d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:49.182624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-86bb64f9-a3cf-40b9-b273-341cfdf63c1d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:49.316390 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-86bb64f9-a3cf-40b9-b273-341cfdf63c1d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:49.324570 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-86bb64f9-a3cf-40b9-b273-341cfdf63c1d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.154898 May 13 14:57:49.325171 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 211/450] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:49 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:49.389375 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-815077b5-7214-4f51-91a5-0fd36737901e req-917ba664-3251-4eb4-bf4c-b3a3571c5490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96db69fe-6594-486c-96b3-545e6dbfa29b", "name": "network-vif-plugged", "status": "completed", "tag": "4fd5686b-8efb-4342-9683-06dad26579b5"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:49.397642 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-815077b5-7214-4f51-91a5-0fd36737901e req-917ba664-3251-4eb4-bf4c-b3a3571c5490 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:49.398077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-815077b5-7214-4f51-91a5-0fd36737901e req-917ba664-3251-4eb4-bf4c-b3a3571c5490 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:49.410042 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-815077b5-7214-4f51-91a5-0fd36737901e req-917ba664-3251-4eb4-bf4c-b3a3571c5490 service nova] Creating event network-vif-plugged:4fd5686b-8efb-4342-9683-06dad26579b5 for instance 96db69fe-6594-486c-96b3-545e6dbfa29b on hv-cinder-83090 May 13 14:57:49.414936 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-815077b5-7214-4f51-91a5-0fd36737901e req-917ba664-3251-4eb4-bf4c-b3a3571c5490 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029262 May 13 14:57:49.415527 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 240/451] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:57:49.615369 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-472abaf0-c017-4083-9f1c-abc87046144d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:49.616412 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-472abaf0-c017-4083-9f1c-abc87046144d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:49.625278 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-472abaf0-c017-4083-9f1c-abc87046144d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:49.625729 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-472abaf0-c017-4083-9f1c-abc87046144d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:49.626510 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-472abaf0-c017-4083-9f1c-abc87046144d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:49.626939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-472abaf0-c017-4083-9f1c-abc87046144d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:49.710461 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c9a758fe-991d-42b0-977d-dc75b3556b6f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:49.711287 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c9a758fe-991d-42b0-977d-dc75b3556b6f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:49.717700 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c9a758fe-991d-42b0-977d-dc75b3556b6f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:49.718137 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c9a758fe-991d-42b0-977d-dc75b3556b6f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:49.718901 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c9a758fe-991d-42b0-977d-dc75b3556b6f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:49.719374 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c9a758fe-991d-42b0-977d-dc75b3556b6f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:49.776190 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-472abaf0-c017-4083-9f1c-abc87046144d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:49.785217 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-472abaf0-c017-4083-9f1c-abc87046144d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:49.786659 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-472abaf0-c017-4083-9f1c-abc87046144d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:49.787895 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-472abaf0-c017-4083-9f1c-abc87046144d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1744 microversion: 2.20 time: 0.179166 May 13 14:57:49.805044 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 212/452] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:49 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1744 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:49.867681 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c9a758fe-991d-42b0-977d-dc75b3556b6f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:49.876902 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c9a758fe-991d-42b0-977d-dc75b3556b6f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1365 microversion: 2.1 time: 0.171066 May 13 14:57:49.877461 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 241/453] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:49 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:50.341646 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-64d8d532-fcb7-4e07-a126-fb01450c93f5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:50.342267 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-64d8d532-fcb7-4e07-a126-fb01450c93f5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:50.349158 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-64d8d532-fcb7-4e07-a126-fb01450c93f5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:50.349690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-64d8d532-fcb7-4e07-a126-fb01450c93f5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:50.350544 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-64d8d532-fcb7-4e07-a126-fb01450c93f5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:50.351208 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-64d8d532-fcb7-4e07-a126-fb01450c93f5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:50.488736 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-64d8d532-fcb7-4e07-a126-fb01450c93f5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:50.496622 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-64d8d532-fcb7-4e07-a126-fb01450c93f5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.159005 May 13 14:57:50.497187 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 213/454] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:50 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:50.562217 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-68f3b400-d701-44e8-92bd-c717e5683ce7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e362dfe-5310-4fc8-b9bd-0b40f6f8c841", "device": "/dev/sdb"}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:50.563809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-68f3b400-d701-44e8-92bd-c717e5683ce7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:50.569834 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68f3b400-d701-44e8-92bd-c717e5683ce7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:50.570269 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68f3b400-d701-44e8-92bd-c717e5683ce7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:50.571036 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68f3b400-d701-44e8-92bd-c717e5683ce7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:50.571461 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68f3b400-d701-44e8-92bd-c717e5683ce7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:50.817362 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ac265afa-9857-41ec-88b5-cf8fd09ca024 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:50.817970 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ac265afa-9857-41ec-88b5-cf8fd09ca024 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:50.824552 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ac265afa-9857-41ec-88b5-cf8fd09ca024 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:50.825240 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ac265afa-9857-41ec-88b5-cf8fd09ca024 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:50.826371 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ac265afa-9857-41ec-88b5-cf8fd09ca024 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:50.826890 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ac265afa-9857-41ec-88b5-cf8fd09ca024 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:50.871306 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-68f3b400-d701-44e8-92bd-c717e5683ce7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "POST /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313008 May 13 14:57:50.872461 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 242/455] 10.222.0.99 () {60 vars in 1322 bytes} [Fri May 13 14:57:50 2022] POST /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:57:50.895805 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-8e0e0598-eca9-4346-93b0-2130a020ecec tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:50.896536 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-8e0e0598-eca9-4346-93b0-2130a020ecec tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:50.903699 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8e0e0598-eca9-4346-93b0-2130a020ecec tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:50.904168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8e0e0598-eca9-4346-93b0-2130a020ecec tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:50.904983 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8e0e0598-eca9-4346-93b0-2130a020ecec tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:50.905407 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8e0e0598-eca9-4346-93b0-2130a020ecec tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:51.014864 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ac265afa-9857-41ec-88b5-cf8fd09ca024 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:51.024693 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ac265afa-9857-41ec-88b5-cf8fd09ca024 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:51.026253 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ac265afa-9857-41ec-88b5-cf8fd09ca024 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:51.027487 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ac265afa-9857-41ec-88b5-cf8fd09ca024 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1744 microversion: 2.20 time: 0.215000 May 13 14:57:51.028280 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 214/456] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:50 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1744 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:51.064599 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-8e0e0598-eca9-4346-93b0-2130a020ecec tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:51.072022 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-8e0e0598-eca9-4346-93b0-2130a020ecec tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1365 microversion: 2.1 time: 0.181480 May 13 14:57:51.072835 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 243/457] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:50 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:51.517140 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-bce8c001-9a98-4c8b-b040-48047edba81c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:51.518261 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-bce8c001-9a98-4c8b-b040-48047edba81c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:51.525322 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bce8c001-9a98-4c8b-b040-48047edba81c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:51.525760 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bce8c001-9a98-4c8b-b040-48047edba81c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:51.526529 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bce8c001-9a98-4c8b-b040-48047edba81c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:51.527015 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bce8c001-9a98-4c8b-b040-48047edba81c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:51.665018 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-bce8c001-9a98-4c8b-b040-48047edba81c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:51.673308 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-bce8c001-9a98-4c8b-b040-48047edba81c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.162630 May 13 14:57:51.673883 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 215/458] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:51 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:52.046010 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-55db1f02-60cd-4a3e-96d2-c9590b08e6a9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:52.046724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-55db1f02-60cd-4a3e-96d2-c9590b08e6a9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:52.053786 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-55db1f02-60cd-4a3e-96d2-c9590b08e6a9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:52.054231 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-55db1f02-60cd-4a3e-96d2-c9590b08e6a9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:52.054999 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-55db1f02-60cd-4a3e-96d2-c9590b08e6a9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:52.055429 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-55db1f02-60cd-4a3e-96d2-c9590b08e6a9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:52.090370 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-033847f3-e593-4f4e-8283-587f217e3347 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:52.101080 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-033847f3-e593-4f4e-8283-587f217e3347 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:52.108983 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-033847f3-e593-4f4e-8283-587f217e3347 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:52.109565 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-033847f3-e593-4f4e-8283-587f217e3347 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:52.110433 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-033847f3-e593-4f4e-8283-587f217e3347 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:52.110935 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-033847f3-e593-4f4e-8283-587f217e3347 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:52.241957 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-55db1f02-60cd-4a3e-96d2-c9590b08e6a9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:52.250042 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-55db1f02-60cd-4a3e-96d2-c9590b08e6a9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:52.251546 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-55db1f02-60cd-4a3e-96d2-c9590b08e6a9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:52.252756 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-55db1f02-60cd-4a3e-96d2-c9590b08e6a9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1744 microversion: 2.20 time: 0.210811 May 13 14:57:52.253247 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 244/459] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:52 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1744 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:52.272342 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-033847f3-e593-4f4e-8283-587f217e3347 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:52.280318 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-033847f3-e593-4f4e-8283-587f217e3347 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1365 microversion: 2.1 time: 0.193754 May 13 14:57:52.280885 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 216/460] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:52 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:52.696095 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-bf30fe3e-0768-479d-af6e-4cb6daa3816c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:52.697080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-bf30fe3e-0768-479d-af6e-4cb6daa3816c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:52.705427 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf30fe3e-0768-479d-af6e-4cb6daa3816c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:52.705866 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf30fe3e-0768-479d-af6e-4cb6daa3816c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:52.706628 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf30fe3e-0768-479d-af6e-4cb6daa3816c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:52.707056 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf30fe3e-0768-479d-af6e-4cb6daa3816c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:52.852252 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-bf30fe3e-0768-479d-af6e-4cb6daa3816c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:52.861067 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-bf30fe3e-0768-479d-af6e-4cb6daa3816c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.171832 May 13 14:57:52.861645 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 245/461] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:52 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:53.275260 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e404d582-cbcf-404f-b47a-03fa24e2911d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:53.276229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-e404d582-cbcf-404f-b47a-03fa24e2911d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:53.284719 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e404d582-cbcf-404f-b47a-03fa24e2911d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:53.285168 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e404d582-cbcf-404f-b47a-03fa24e2911d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:53.285945 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e404d582-cbcf-404f-b47a-03fa24e2911d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:53.286377 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e404d582-cbcf-404f-b47a-03fa24e2911d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:53.299958 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-801a364e-6c9e-4cdc-85c5-7cedaa6bcbc7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:53.300950 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-801a364e-6c9e-4cdc-85c5-7cedaa6bcbc7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:53.310474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-801a364e-6c9e-4cdc-85c5-7cedaa6bcbc7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:53.310924 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-801a364e-6c9e-4cdc-85c5-7cedaa6bcbc7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:53.311783 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-801a364e-6c9e-4cdc-85c5-7cedaa6bcbc7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:53.312186 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-801a364e-6c9e-4cdc-85c5-7cedaa6bcbc7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:53.475765 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e404d582-cbcf-404f-b47a-03fa24e2911d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:53.484546 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e404d582-cbcf-404f-b47a-03fa24e2911d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:53.486039 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e404d582-cbcf-404f-b47a-03fa24e2911d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:53.487214 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e404d582-cbcf-404f-b47a-03fa24e2911d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1744 microversion: 2.20 time: 0.218496 May 13 14:57:53.487788 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 217/462] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:53 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:53.503183 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-801a364e-6c9e-4cdc-85c5-7cedaa6bcbc7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:53.511369 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-801a364e-6c9e-4cdc-85c5-7cedaa6bcbc7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1365 microversion: 2.1 time: 0.217415 May 13 14:57:53.512220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 246/463] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:53 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:53.639308 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-2fda5cf9-9c36-48f4-aa44-b69865f90dcf req-086c45c9-db7e-4bbe-b6cf-925fd69df938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea83690-7cf5-475e-9339-4bf228b48893", "name": "network-vif-plugged", "status": "completed", "tag": "05c9f616-6d8a-443a-adf5-507c9b933e77"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:53.648600 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-2fda5cf9-9c36-48f4-aa44-b69865f90dcf req-086c45c9-db7e-4bbe-b6cf-925fd69df938 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:53.649134 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-2fda5cf9-9c36-48f4-aa44-b69865f90dcf req-086c45c9-db7e-4bbe-b6cf-925fd69df938 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:53.660505 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-2fda5cf9-9c36-48f4-aa44-b69865f90dcf req-086c45c9-db7e-4bbe-b6cf-925fd69df938 service nova] Creating event network-vif-plugged:05c9f616-6d8a-443a-adf5-507c9b933e77 for instance 8ea83690-7cf5-475e-9339-4bf228b48893 on hv-cinder-83090 May 13 14:57:53.665544 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-2fda5cf9-9c36-48f4-aa44-b69865f90dcf req-086c45c9-db7e-4bbe-b6cf-925fd69df938 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029964 May 13 14:57:53.666284 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 218/464] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:57:53.878995 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f3854269-60a0-4be0-9a39-7879cd9a323e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:53.879520 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f3854269-60a0-4be0-9a39-7879cd9a323e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:53.885924 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f3854269-60a0-4be0-9a39-7879cd9a323e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:53.886377 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f3854269-60a0-4be0-9a39-7879cd9a323e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:53.887149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f3854269-60a0-4be0-9a39-7879cd9a323e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:53.887586 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f3854269-60a0-4be0-9a39-7879cd9a323e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:54.034996 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f3854269-60a0-4be0-9a39-7879cd9a323e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:54.043015 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f3854269-60a0-4be0-9a39-7879cd9a323e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.168137 May 13 14:57:54.043583 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 247/465] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:53 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:54.507371 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1ae41242-cdaa-44db-83f0-8869c8a6802a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:54.508017 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1ae41242-cdaa-44db-83f0-8869c8a6802a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:54.515011 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1ae41242-cdaa-44db-83f0-8869c8a6802a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:54.515714 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1ae41242-cdaa-44db-83f0-8869c8a6802a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:54.516264 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1ae41242-cdaa-44db-83f0-8869c8a6802a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:54.516701 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1ae41242-cdaa-44db-83f0-8869c8a6802a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:54.529668 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-01de87e8-a56e-430d-9874-625cac45aa53 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:54.530355 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-01de87e8-a56e-430d-9874-625cac45aa53 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:54.537238 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-01de87e8-a56e-430d-9874-625cac45aa53 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:54.537678 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-01de87e8-a56e-430d-9874-625cac45aa53 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:54.538427 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-01de87e8-a56e-430d-9874-625cac45aa53 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:54.538855 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-01de87e8-a56e-430d-9874-625cac45aa53 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:54.699678 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1ae41242-cdaa-44db-83f0-8869c8a6802a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:54.708452 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1ae41242-cdaa-44db-83f0-8869c8a6802a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:54.710027 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1ae41242-cdaa-44db-83f0-8869c8a6802a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:54.711201 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1ae41242-cdaa-44db-83f0-8869c8a6802a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1744 microversion: 2.20 time: 0.208801 May 13 14:57:54.712088 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 219/466] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:54 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1744 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:54.726488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-01de87e8-a56e-430d-9874-625cac45aa53 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:54.734682 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-01de87e8-a56e-430d-9874-625cac45aa53 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1365 microversion: 2.1 time: 0.208892 May 13 14:57:54.735252 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 248/467] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:54 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:55.062502 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-673f8b9e-c3da-4806-81d8-952f3423b3e0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:55.063331 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-673f8b9e-c3da-4806-81d8-952f3423b3e0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:55.071471 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-673f8b9e-c3da-4806-81d8-952f3423b3e0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:55.072104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-673f8b9e-c3da-4806-81d8-952f3423b3e0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:55.073115 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-673f8b9e-c3da-4806-81d8-952f3423b3e0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:55.073689 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-673f8b9e-c3da-4806-81d8-952f3423b3e0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:55.212004 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-673f8b9e-c3da-4806-81d8-952f3423b3e0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:55.220539 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-673f8b9e-c3da-4806-81d8-952f3423b3e0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.163233 May 13 14:57:55.221114 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 220/468] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:55 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:55.730361 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c25d5a0e-346e-4577-bc69-42b4669e0588 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:55.731377 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c25d5a0e-346e-4577-bc69-42b4669e0588 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:55.738279 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c25d5a0e-346e-4577-bc69-42b4669e0588 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:55.738724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c25d5a0e-346e-4577-bc69-42b4669e0588 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:55.739543 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c25d5a0e-346e-4577-bc69-42b4669e0588 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:55.739973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c25d5a0e-346e-4577-bc69-42b4669e0588 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:55.751690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-74f16081-b4e9-471c-a354-3050721c9f0b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:55.752309 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-74f16081-b4e9-471c-a354-3050721c9f0b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:55.759079 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-74f16081-b4e9-471c-a354-3050721c9f0b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:55.759527 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-74f16081-b4e9-471c-a354-3050721c9f0b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:55.760344 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-74f16081-b4e9-471c-a354-3050721c9f0b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:55.760780 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-74f16081-b4e9-471c-a354-3050721c9f0b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:55.933891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c25d5a0e-346e-4577-bc69-42b4669e0588 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:55.941547 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-74f16081-b4e9-471c-a354-3050721c9f0b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:55.942401 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c25d5a0e-346e-4577-bc69-42b4669e0588 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:55.943900 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c25d5a0e-346e-4577-bc69-42b4669e0588 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:55.945347 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c25d5a0e-346e-4577-bc69-42b4669e0588 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1744 microversion: 2.20 time: 0.218819 May 13 14:57:55.945905 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 249/469] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:55 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:55.949069 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-74f16081-b4e9-471c-a354-3050721c9f0b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1365 microversion: 2.1 time: 0.201342 May 13 14:57:55.949639 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 221/470] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:55 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:56.238194 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d95c6acc-0080-4ff6-ada7-ff300f20861a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:56.238801 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d95c6acc-0080-4ff6-ada7-ff300f20861a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:56.245216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d95c6acc-0080-4ff6-ada7-ff300f20861a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:56.245701 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d95c6acc-0080-4ff6-ada7-ff300f20861a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:56.246469 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d95c6acc-0080-4ff6-ada7-ff300f20861a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:56.246905 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d95c6acc-0080-4ff6-ada7-ff300f20861a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:56.389857 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d95c6acc-0080-4ff6-ada7-ff300f20861a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:56.398688 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d95c6acc-0080-4ff6-ada7-ff300f20861a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.164515 May 13 14:57:56.399394 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 250/471] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:56 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:56.963672 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a25a5834-492b-45f4-9a7e-58e30a6dd615 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:56.964312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a25a5834-492b-45f4-9a7e-58e30a6dd615 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:56.965603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c1daf81d-bc2f-49b8-ba7f-98da96c946ac tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:56.966304 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c1daf81d-bc2f-49b8-ba7f-98da96c946ac tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:56.971601 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a25a5834-492b-45f4-9a7e-58e30a6dd615 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:56.972097 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a25a5834-492b-45f4-9a7e-58e30a6dd615 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:56.972882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a25a5834-492b-45f4-9a7e-58e30a6dd615 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:56.973315 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a25a5834-492b-45f4-9a7e-58e30a6dd615 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:56.973571 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c1daf81d-bc2f-49b8-ba7f-98da96c946ac tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:56.974014 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c1daf81d-bc2f-49b8-ba7f-98da96c946ac tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:56.974794 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c1daf81d-bc2f-49b8-ba7f-98da96c946ac tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:56.975224 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c1daf81d-bc2f-49b8-ba7f-98da96c946ac tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:57.162422 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-a25a5834-492b-45f4-9a7e-58e30a6dd615 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:57.165542 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c1daf81d-bc2f-49b8-ba7f-98da96c946ac tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:57.173158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c1daf81d-bc2f-49b8-ba7f-98da96c946ac tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1556 microversion: 2.1 time: 0.211994 May 13 14:57:57.173691 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-a25a5834-492b-45f4-9a7e-58e30a6dd615 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:57.174207 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 251/472] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:56 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1556 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:57.175222 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-a25a5834-492b-45f4-9a7e-58e30a6dd615 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:57.176437 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a25a5834-492b-45f4-9a7e-58e30a6dd615 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1744 microversion: 2.20 time: 0.216884 May 13 14:57:57.181412 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 222/473] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:56 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1744 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:57.189611 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9c4c3a5b-7422-4ac5-9ce8-ed4ec98b11ae tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:57.190100 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9c4c3a5b-7422-4ac5-9ce8-ed4ec98b11ae tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:57.196208 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9c4c3a5b-7422-4ac5-9ce8-ed4ec98b11ae tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:57.196651 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9c4c3a5b-7422-4ac5-9ce8-ed4ec98b11ae tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:57.197417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9c4c3a5b-7422-4ac5-9ce8-ed4ec98b11ae tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:57.197844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9c4c3a5b-7422-4ac5-9ce8-ed4ec98b11ae tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:57.282513 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9c4c3a5b-7422-4ac5-9ce8-ed4ec98b11ae tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097138 May 13 14:57:57.283131 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 252/474] 10.222.0.99 () {58 vars in 1274 bytes} [Fri May 13 14:57:57 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:57:57.416452 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-011f61a7-5277-41dd-aa14-d03392e7bb98 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:57.417090 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-011f61a7-5277-41dd-aa14-d03392e7bb98 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:57.424009 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-011f61a7-5277-41dd-aa14-d03392e7bb98 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:57.424460 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-011f61a7-5277-41dd-aa14-d03392e7bb98 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:57.425264 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-011f61a7-5277-41dd-aa14-d03392e7bb98 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:57.425676 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-011f61a7-5277-41dd-aa14-d03392e7bb98 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:57.702690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-011f61a7-5277-41dd-aa14-d03392e7bb98 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:57.711886 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-011f61a7-5277-41dd-aa14-d03392e7bb98 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.299080 May 13 14:57:57.712639 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 223/475] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:57 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:58.197844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-765d7936-b06e-48b1-885b-7ea4d8ffeebe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:58.198394 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-765d7936-b06e-48b1-885b-7ea4d8ffeebe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:58.205016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-765d7936-b06e-48b1-885b-7ea4d8ffeebe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:58.205669 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-765d7936-b06e-48b1-885b-7ea4d8ffeebe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:58.206449 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-765d7936-b06e-48b1-885b-7ea4d8ffeebe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:58.206883 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-765d7936-b06e-48b1-885b-7ea4d8ffeebe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:58.677332 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-765d7936-b06e-48b1-885b-7ea4d8ffeebe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:58.685925 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-c2675a60-bdd8-4aae-9fae-dac79ce190a2 req-dfb674d7-15e4-4b08-85f5-04b8d79b6a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea83690-7cf5-475e-9339-4bf228b48893", "tag": "05c9f616-6d8a-443a-adf5-507c9b933e77"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:57:58.689299 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-765d7936-b06e-48b1-885b-7ea4d8ffeebe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:58.693164 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-765d7936-b06e-48b1-885b-7ea4d8ffeebe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:58.696350 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-c2675a60-bdd8-4aae-9fae-dac79ce190a2 req-dfb674d7-15e4-4b08-85f5-04b8d79b6a02 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:58.696794 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-c2675a60-bdd8-4aae-9fae-dac79ce190a2 req-dfb674d7-15e4-4b08-85f5-04b8d79b6a02 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:58.696921 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-765d7936-b06e-48b1-885b-7ea4d8ffeebe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1739 microversion: 2.20 time: 0.505794 May 13 14:57:58.697407 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 253/476] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:58 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1739 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:57:58.709003 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-c2675a60-bdd8-4aae-9fae-dac79ce190a2 req-dfb674d7-15e4-4b08-85f5-04b8d79b6a02 service nova] Creating event network-changed:05c9f616-6d8a-443a-adf5-507c9b933e77 for instance 8ea83690-7cf5-475e-9339-4bf228b48893 on hv-cinder-83090 May 13 14:57:58.714681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-c2675a60-bdd8-4aae-9fae-dac79ce190a2 req-dfb674d7-15e4-4b08-85f5-04b8d79b6a02 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032707 May 13 14:57:58.718705 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 224/477] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:57:58.728902 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-378aaa97-e3b4-4373-86ef-fe3dd3fcd680 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:58.729650 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-378aaa97-e3b4-4373-86ef-fe3dd3fcd680 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:58.737008 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-378aaa97-e3b4-4373-86ef-fe3dd3fcd680 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:58.737459 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-378aaa97-e3b4-4373-86ef-fe3dd3fcd680 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:58.738443 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-378aaa97-e3b4-4373-86ef-fe3dd3fcd680 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:58.738663 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-378aaa97-e3b4-4373-86ef-fe3dd3fcd680 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:58.901179 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-378aaa97-e3b4-4373-86ef-fe3dd3fcd680 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:57:58.912438 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-378aaa97-e3b4-4373-86ef-fe3dd3fcd680 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.187319 May 13 14:57:58.913794 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 254/478] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:58 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:57:59.720692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6b927bd1-8190-456a-9470-cc62faf56cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:59.721390 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6b927bd1-8190-456a-9470-cc62faf56cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:59.745229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6b927bd1-8190-456a-9470-cc62faf56cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:59.745584 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6b927bd1-8190-456a-9470-cc62faf56cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:59.746390 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6b927bd1-8190-456a-9470-cc62faf56cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:59.753037 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6b927bd1-8190-456a-9470-cc62faf56cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:59.931460 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-a8140e3d-6f30-47af-900e-8e25cd92e586 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:57:59.932290 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-a8140e3d-6f30-47af-900e-8e25cd92e586 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:57:59.940067 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a8140e3d-6f30-47af-900e-8e25cd92e586 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:59.940507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a8140e3d-6f30-47af-900e-8e25cd92e586 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:57:59.941334 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a8140e3d-6f30-47af-900e-8e25cd92e586 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:57:59.941758 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a8140e3d-6f30-47af-900e-8e25cd92e586 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:00.068969 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6b927bd1-8190-456a-9470-cc62faf56cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:00.078114 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6b927bd1-8190-456a-9470-cc62faf56cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:00.079792 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6b927bd1-8190-456a-9470-cc62faf56cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:00.081223 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6b927bd1-8190-456a-9470-cc62faf56cac tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1739 microversion: 2.20 time: 0.367823 May 13 14:58:00.092879 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 225/479] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:57:59 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1739 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:00.141914 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-a8140e3d-6f30-47af-900e-8e25cd92e586 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:00.153649 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-a8140e3d-6f30-47af-900e-8e25cd92e586 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.226021 May 13 14:58:00.154382 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 255/480] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:57:59 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:01.099794 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-28e63c2f-98fc-433a-badc-522f4c71f984 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:01.100593 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-28e63c2f-98fc-433a-badc-522f4c71f984 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:01.108121 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-28e63c2f-98fc-433a-badc-522f4c71f984 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:01.108565 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-28e63c2f-98fc-433a-badc-522f4c71f984 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:01.109550 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-28e63c2f-98fc-433a-badc-522f4c71f984 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:01.110196 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-28e63c2f-98fc-433a-badc-522f4c71f984 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:01.171455 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-cd6cbd6d-b04c-4c48-a253-6ee2be479dd8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:01.172750 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-cd6cbd6d-b04c-4c48-a253-6ee2be479dd8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:01.179478 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cd6cbd6d-b04c-4c48-a253-6ee2be479dd8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:01.180170 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cd6cbd6d-b04c-4c48-a253-6ee2be479dd8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:01.181169 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cd6cbd6d-b04c-4c48-a253-6ee2be479dd8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:01.181777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cd6cbd6d-b04c-4c48-a253-6ee2be479dd8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:01.307405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-28e63c2f-98fc-433a-badc-522f4c71f984 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:01.320507 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-28e63c2f-98fc-433a-badc-522f4c71f984 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:01.323163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-28e63c2f-98fc-433a-badc-522f4c71f984 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:01.324952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-28e63c2f-98fc-433a-badc-522f4c71f984 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1739 microversion: 2.20 time: 0.229300 May 13 14:58:01.326111 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 226/481] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:01 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:01.383653 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-cd6cbd6d-b04c-4c48-a253-6ee2be479dd8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:01.392846 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-cd6cbd6d-b04c-4c48-a253-6ee2be479dd8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.225991 May 13 14:58:01.399628 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 256/482] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:01 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:58:02.345343 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e44ab707-e2cc-4b2e-a808-134ad8334a2f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:02.346500 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-e44ab707-e2cc-4b2e-a808-134ad8334a2f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:02.354012 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e44ab707-e2cc-4b2e-a808-134ad8334a2f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:02.354532 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e44ab707-e2cc-4b2e-a808-134ad8334a2f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:02.355350 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e44ab707-e2cc-4b2e-a808-134ad8334a2f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:02.356151 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e44ab707-e2cc-4b2e-a808-134ad8334a2f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:02.409860 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-210ffe42-d333-4ccd-8906-46a75634d65a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:02.410465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-210ffe42-d333-4ccd-8906-46a75634d65a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:02.417898 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-210ffe42-d333-4ccd-8906-46a75634d65a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:02.418553 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-210ffe42-d333-4ccd-8906-46a75634d65a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:02.420620 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-210ffe42-d333-4ccd-8906-46a75634d65a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:02.421281 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-210ffe42-d333-4ccd-8906-46a75634d65a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:02.559137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e44ab707-e2cc-4b2e-a808-134ad8334a2f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:02.568905 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e44ab707-e2cc-4b2e-a808-134ad8334a2f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:02.571087 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e44ab707-e2cc-4b2e-a808-134ad8334a2f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:02.572652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e44ab707-e2cc-4b2e-a808-134ad8334a2f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1739 microversion: 2.20 time: 0.232751 May 13 14:58:02.585030 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 227/483] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:02 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:02.615192 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-210ffe42-d333-4ccd-8906-46a75634d65a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:02.624926 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-210ffe42-d333-4ccd-8906-46a75634d65a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.218937 May 13 14:58:02.625844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 257/484] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:02 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:03.590711 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9fdf5890-6157-43f6-870b-7f5ef07bbbf9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:03.591964 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-9fdf5890-6157-43f6-870b-7f5ef07bbbf9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:03.598678 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9fdf5890-6157-43f6-870b-7f5ef07bbbf9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:03.599931 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9fdf5890-6157-43f6-870b-7f5ef07bbbf9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:03.600061 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9fdf5890-6157-43f6-870b-7f5ef07bbbf9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:03.600570 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9fdf5890-6157-43f6-870b-7f5ef07bbbf9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:03.645602 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c55d1e6d-3120-445c-85fa-45f52fcabe39 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:03.646962 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c55d1e6d-3120-445c-85fa-45f52fcabe39 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:03.653737 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c55d1e6d-3120-445c-85fa-45f52fcabe39 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:03.654664 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c55d1e6d-3120-445c-85fa-45f52fcabe39 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:03.655999 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c55d1e6d-3120-445c-85fa-45f52fcabe39 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:03.656674 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c55d1e6d-3120-445c-85fa-45f52fcabe39 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:03.785362 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9fdf5890-6157-43f6-870b-7f5ef07bbbf9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:03.793953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9fdf5890-6157-43f6-870b-7f5ef07bbbf9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:03.796170 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9fdf5890-6157-43f6-870b-7f5ef07bbbf9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:03.797584 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9fdf5890-6157-43f6-870b-7f5ef07bbbf9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1739 microversion: 2.20 time: 0.210855 May 13 14:58:03.808559 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 228/485] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:03 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:03.844682 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c55d1e6d-3120-445c-85fa-45f52fcabe39 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:03.854278 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c55d1e6d-3120-445c-85fa-45f52fcabe39 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.216794 May 13 14:58:03.863571 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 258/486] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:03 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:58:04.822203 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-be20ea31-b0f1-48b8-b527-3eb2ddd29956 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:04.824220 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-be20ea31-b0f1-48b8-b527-3eb2ddd29956 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:04.833882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-be20ea31-b0f1-48b8-b527-3eb2ddd29956 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:04.834640 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-be20ea31-b0f1-48b8-b527-3eb2ddd29956 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:04.835609 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-be20ea31-b0f1-48b8-b527-3eb2ddd29956 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:04.836286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-be20ea31-b0f1-48b8-b527-3eb2ddd29956 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:04.874440 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4192c8f2-6676-4e3b-b814-02190bc10aed tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:04.875813 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4192c8f2-6676-4e3b-b814-02190bc10aed tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:04.882778 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4192c8f2-6676-4e3b-b814-02190bc10aed tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:04.883576 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4192c8f2-6676-4e3b-b814-02190bc10aed tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:04.884621 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4192c8f2-6676-4e3b-b814-02190bc10aed tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:04.885119 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4192c8f2-6676-4e3b-b814-02190bc10aed tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:05.053543 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-be20ea31-b0f1-48b8-b527-3eb2ddd29956 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:05.062694 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-be20ea31-b0f1-48b8-b527-3eb2ddd29956 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:05.064230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-be20ea31-b0f1-48b8-b527-3eb2ddd29956 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:05.065612 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-be20ea31-b0f1-48b8-b527-3eb2ddd29956 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1739 microversion: 2.20 time: 0.248345 May 13 14:58:05.066772 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 229/487] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:04 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:05.136396 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4192c8f2-6676-4e3b-b814-02190bc10aed tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:05.150023 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4192c8f2-6676-4e3b-b814-02190bc10aed tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.279588 May 13 14:58:05.160163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 259/488] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:04 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:58:06.084548 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-0646d9a7-1a3b-4fb0-99d8-98c70b654b13 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:06.086012 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-0646d9a7-1a3b-4fb0-99d8-98c70b654b13 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:06.093438 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0646d9a7-1a3b-4fb0-99d8-98c70b654b13 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:06.094208 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0646d9a7-1a3b-4fb0-99d8-98c70b654b13 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:06.095038 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0646d9a7-1a3b-4fb0-99d8-98c70b654b13 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:06.095759 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0646d9a7-1a3b-4fb0-99d8-98c70b654b13 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:06.168150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-b6675c5a-38ec-4b70-8a94-f0e4f98ef072 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:06.169535 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-b6675c5a-38ec-4b70-8a94-f0e4f98ef072 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:06.177153 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b6675c5a-38ec-4b70-8a94-f0e4f98ef072 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:06.178563 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b6675c5a-38ec-4b70-8a94-f0e4f98ef072 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:06.180081 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b6675c5a-38ec-4b70-8a94-f0e4f98ef072 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:06.180742 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b6675c5a-38ec-4b70-8a94-f0e4f98ef072 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:06.297734 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-0646d9a7-1a3b-4fb0-99d8-98c70b654b13 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:06.307710 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-0646d9a7-1a3b-4fb0-99d8-98c70b654b13 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:06.309217 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-0646d9a7-1a3b-4fb0-99d8-98c70b654b13 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:06.310599 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-0646d9a7-1a3b-4fb0-99d8-98c70b654b13 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1739 microversion: 2.20 time: 0.229722 May 13 14:58:06.311166 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 230/489] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:06 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:06.371619 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b6675c5a-38ec-4b70-8a94-f0e4f98ef072 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:06.380156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-b6675c5a-38ec-4b70-8a94-f0e4f98ef072 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.216159 May 13 14:58:06.380737 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 260/490] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:06 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:07.329717 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-acca5c2a-289b-4bcc-b96d-a49bbdd473dc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:07.330326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-acca5c2a-289b-4bcc-b96d-a49bbdd473dc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:07.339657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-acca5c2a-289b-4bcc-b96d-a49bbdd473dc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:07.340137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-acca5c2a-289b-4bcc-b96d-a49bbdd473dc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:07.341108 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-acca5c2a-289b-4bcc-b96d-a49bbdd473dc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:07.341724 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-acca5c2a-289b-4bcc-b96d-a49bbdd473dc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:07.397479 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-adbdff62-e069-4125-a210-569cfeddf4bd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:07.399267 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-adbdff62-e069-4125-a210-569cfeddf4bd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:07.406638 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-adbdff62-e069-4125-a210-569cfeddf4bd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:07.407303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-adbdff62-e069-4125-a210-569cfeddf4bd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:07.408944 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-adbdff62-e069-4125-a210-569cfeddf4bd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:07.409568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-adbdff62-e069-4125-a210-569cfeddf4bd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:07.516499 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-acca5c2a-289b-4bcc-b96d-a49bbdd473dc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:07.533446 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-acca5c2a-289b-4bcc-b96d-a49bbdd473dc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:07.536144 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-acca5c2a-289b-4bcc-b96d-a49bbdd473dc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:07.538566 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-acca5c2a-289b-4bcc-b96d-a49bbdd473dc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1739 microversion: 2.20 time: 0.212768 May 13 14:58:07.552723 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 231/491] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:07 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:07.603841 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-adbdff62-e069-4125-a210-569cfeddf4bd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:07.614727 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-adbdff62-e069-4125-a210-569cfeddf4bd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.220920 May 13 14:58:07.615412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 261/492] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:07 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:08.561060 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-39f8df72-b271-496f-b1d3-7ad660711f73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:08.561707 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-39f8df72-b271-496f-b1d3-7ad660711f73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:08.568912 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-39f8df72-b271-496f-b1d3-7ad660711f73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:08.569380 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-39f8df72-b271-496f-b1d3-7ad660711f73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:08.570191 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-39f8df72-b271-496f-b1d3-7ad660711f73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:08.570644 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-39f8df72-b271-496f-b1d3-7ad660711f73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:08.634990 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-24d82872-3415-4375-9492-556f146b11bb tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:08.635584 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-24d82872-3415-4375-9492-556f146b11bb tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:08.643077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-24d82872-3415-4375-9492-556f146b11bb tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:08.643541 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-24d82872-3415-4375-9492-556f146b11bb tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:08.644335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-24d82872-3415-4375-9492-556f146b11bb tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:08.644773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-24d82872-3415-4375-9492-556f146b11bb tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:08.751227 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-39f8df72-b271-496f-b1d3-7ad660711f73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:08.759498 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-39f8df72-b271-496f-b1d3-7ad660711f73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:08.761023 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-39f8df72-b271-496f-b1d3-7ad660711f73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:08.762175 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-39f8df72-b271-496f-b1d3-7ad660711f73 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1739 microversion: 2.20 time: 0.205427 May 13 14:58:08.762725 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 232/493] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:08 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:08.802941 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-24d82872-3415-4375-9492-556f146b11bb tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:08.813237 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-24d82872-3415-4375-9492-556f146b11bb tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.184281 May 13 14:58:08.813815 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 262/494] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:08 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:09.781222 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ecd71d6e-be18-4eb5-8449-0106cc6f26dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:09.781791 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ecd71d6e-be18-4eb5-8449-0106cc6f26dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:09.788382 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ecd71d6e-be18-4eb5-8449-0106cc6f26dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:09.788833 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ecd71d6e-be18-4eb5-8449-0106cc6f26dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:09.789603 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ecd71d6e-be18-4eb5-8449-0106cc6f26dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:09.790033 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ecd71d6e-be18-4eb5-8449-0106cc6f26dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:09.834679 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-84ac3704-5e9c-4c74-a8bf-5baee66b3b8e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:09.835354 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-84ac3704-5e9c-4c74-a8bf-5baee66b3b8e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:09.842658 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-84ac3704-5e9c-4c74-a8bf-5baee66b3b8e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:09.843608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-84ac3704-5e9c-4c74-a8bf-5baee66b3b8e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:09.843929 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-84ac3704-5e9c-4c74-a8bf-5baee66b3b8e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:09.844369 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-84ac3704-5e9c-4c74-a8bf-5baee66b3b8e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:09.969357 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ecd71d6e-be18-4eb5-8449-0106cc6f26dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:09.977490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ecd71d6e-be18-4eb5-8449-0106cc6f26dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:09.978962 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ecd71d6e-be18-4eb5-8449-0106cc6f26dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:09.980145 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ecd71d6e-be18-4eb5-8449-0106cc6f26dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1739 microversion: 2.20 time: 0.202933 May 13 14:58:09.981135 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 233/495] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:09 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:58:10.006268 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-84ac3704-5e9c-4c74-a8bf-5baee66b3b8e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:10.014679 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-84ac3704-5e9c-4c74-a8bf-5baee66b3b8e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.183933 May 13 14:58:10.015348 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 263/496] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:09 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:11.002020 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e83491b1-805f-495c-97a0-963d272ec047 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:11.002733 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-e83491b1-805f-495c-97a0-963d272ec047 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:11.010859 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e83491b1-805f-495c-97a0-963d272ec047 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:11.011363 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e83491b1-805f-495c-97a0-963d272ec047 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:11.012346 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e83491b1-805f-495c-97a0-963d272ec047 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:11.013007 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e83491b1-805f-495c-97a0-963d272ec047 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:11.032481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-7968fa1d-b60f-409a-bf5c-05318156341d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:11.033050 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-7968fa1d-b60f-409a-bf5c-05318156341d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:11.039535 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7968fa1d-b60f-409a-bf5c-05318156341d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:11.040007 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7968fa1d-b60f-409a-bf5c-05318156341d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:11.040788 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7968fa1d-b60f-409a-bf5c-05318156341d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:11.041211 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7968fa1d-b60f-409a-bf5c-05318156341d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:11.206117 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e83491b1-805f-495c-97a0-963d272ec047 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:11.214558 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e83491b1-805f-495c-97a0-963d272ec047 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:11.215929 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e83491b1-805f-495c-97a0-963d272ec047 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:11.217065 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-7968fa1d-b60f-409a-bf5c-05318156341d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:11.217241 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e83491b1-805f-495c-97a0-963d272ec047 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1739 microversion: 2.20 time: 0.221019 May 13 14:58:11.217817 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 234/497] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:10 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:11.226286 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-7968fa1d-b60f-409a-bf5c-05318156341d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.197773 May 13 14:58:11.226824 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 264/498] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:11 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:12.237575 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6e8965bb-8ab3-46a8-8905-0ab034b345e4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:12.238341 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6e8965bb-8ab3-46a8-8905-0ab034b345e4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:12.243111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-302d67b6-77c8-449f-b277-1c28c403b471 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:12.243786 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-302d67b6-77c8-449f-b277-1c28c403b471 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:12.245346 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e8965bb-8ab3-46a8-8905-0ab034b345e4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:12.245781 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e8965bb-8ab3-46a8-8905-0ab034b345e4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:12.246578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e8965bb-8ab3-46a8-8905-0ab034b345e4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:12.247005 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e8965bb-8ab3-46a8-8905-0ab034b345e4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:12.250899 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-302d67b6-77c8-449f-b277-1c28c403b471 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:12.251365 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-302d67b6-77c8-449f-b277-1c28c403b471 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:12.252209 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-302d67b6-77c8-449f-b277-1c28c403b471 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:12.252651 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-302d67b6-77c8-449f-b277-1c28c403b471 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:12.486229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6e8965bb-8ab3-46a8-8905-0ab034b345e4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:12.493054 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-302d67b6-77c8-449f-b277-1c28c403b471 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:12.496214 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6e8965bb-8ab3-46a8-8905-0ab034b345e4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:12.497862 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6e8965bb-8ab3-46a8-8905-0ab034b345e4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:12.499145 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6e8965bb-8ab3-46a8-8905-0ab034b345e4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1739 microversion: 2.20 time: 0.266461 May 13 14:58:12.500059 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 235/499] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:12 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:12.504840 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-302d67b6-77c8-449f-b277-1c28c403b471 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.265593 May 13 14:58:12.505402 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 265/500] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:12 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:13.519672 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c81efd80-f280-4136-8305-a69d3d1f5936 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:13.520366 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c81efd80-f280-4136-8305-a69d3d1f5936 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:13.521623 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4324bcdf-dbf5-4206-847e-ac9ed7cb24c3 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:13.522232 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4324bcdf-dbf5-4206-847e-ac9ed7cb24c3 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:13.527206 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c81efd80-f280-4136-8305-a69d3d1f5936 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:13.527655 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c81efd80-f280-4136-8305-a69d3d1f5936 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:13.528475 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c81efd80-f280-4136-8305-a69d3d1f5936 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:13.528911 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c81efd80-f280-4136-8305-a69d3d1f5936 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:13.529010 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4324bcdf-dbf5-4206-847e-ac9ed7cb24c3 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:13.529465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4324bcdf-dbf5-4206-847e-ac9ed7cb24c3 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:13.530643 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4324bcdf-dbf5-4206-847e-ac9ed7cb24c3 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:13.531163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4324bcdf-dbf5-4206-847e-ac9ed7cb24c3 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:13.724246 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c81efd80-f280-4136-8305-a69d3d1f5936 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:13.727140 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4324bcdf-dbf5-4206-847e-ac9ed7cb24c3 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:13.732990 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c81efd80-f280-4136-8305-a69d3d1f5936 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:13.735020 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c81efd80-f280-4136-8305-a69d3d1f5936 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:13.735546 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4324bcdf-dbf5-4206-847e-ac9ed7cb24c3 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.217694 May 13 14:58:13.735714 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c81efd80-f280-4136-8305-a69d3d1f5936 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1721 microversion: 2.20 time: 0.220273 May 13 14:58:13.736156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 266/501] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:13 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:13.736308 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 236/502] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:13 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:14.752971 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-91b3a4b2-f6d5-417e-93f1-c7d57a771c38 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:14.753587 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-91b3a4b2-f6d5-417e-93f1-c7d57a771c38 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:14.754293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-db38f666-c102-49e7-b7be-ce189678a1da tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:14.754895 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-db38f666-c102-49e7-b7be-ce189678a1da tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:14.760341 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-91b3a4b2-f6d5-417e-93f1-c7d57a771c38 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:14.760915 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-91b3a4b2-f6d5-417e-93f1-c7d57a771c38 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:14.761388 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-db38f666-c102-49e7-b7be-ce189678a1da tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:14.761728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-91b3a4b2-f6d5-417e-93f1-c7d57a771c38 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:14.761869 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-db38f666-c102-49e7-b7be-ce189678a1da tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:14.762239 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-91b3a4b2-f6d5-417e-93f1-c7d57a771c38 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:14.762573 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-db38f666-c102-49e7-b7be-ce189678a1da tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:14.763005 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-db38f666-c102-49e7-b7be-ce189678a1da tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:14.957306 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-db38f666-c102-49e7-b7be-ce189678a1da tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:14.961483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-91b3a4b2-f6d5-417e-93f1-c7d57a771c38 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:14.965405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-db38f666-c102-49e7-b7be-ce189678a1da tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:14.967122 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-db38f666-c102-49e7-b7be-ce189678a1da tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:14.968280 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-db38f666-c102-49e7-b7be-ce189678a1da tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1721 microversion: 2.20 time: 0.217992 May 13 14:58:14.968957 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 237/503] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:14 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:14.970532 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-91b3a4b2-f6d5-417e-93f1-c7d57a771c38 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.221593 May 13 14:58:14.971318 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 267/504] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:14 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:15.988720 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d01f50a0-4002-492a-b238-deea41968896 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:15.989379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-fcf50b47-cbdc-4a60-8961-bc9b0d8eadbe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:15.989760 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d01f50a0-4002-492a-b238-deea41968896 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:15.989862 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-fcf50b47-cbdc-4a60-8961-bc9b0d8eadbe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:15.996378 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d01f50a0-4002-492a-b238-deea41968896 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:15.996576 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-fcf50b47-cbdc-4a60-8961-bc9b0d8eadbe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:15.996886 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-fcf50b47-cbdc-4a60-8961-bc9b0d8eadbe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:15.997059 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d01f50a0-4002-492a-b238-deea41968896 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:15.997669 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-fcf50b47-cbdc-4a60-8961-bc9b0d8eadbe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:15.997813 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d01f50a0-4002-492a-b238-deea41968896 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:15.998101 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-fcf50b47-cbdc-4a60-8961-bc9b0d8eadbe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:15.998386 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d01f50a0-4002-492a-b238-deea41968896 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:16.188309 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d01f50a0-4002-492a-b238-deea41968896 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:16.196535 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-fcf50b47-cbdc-4a60-8961-bc9b0d8eadbe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:16.199328 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d01f50a0-4002-492a-b238-deea41968896 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.214324 May 13 14:58:16.200151 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 268/505] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:15 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:16.206996 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-fcf50b47-cbdc-4a60-8961-bc9b0d8eadbe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:16.208514 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-fcf50b47-cbdc-4a60-8961-bc9b0d8eadbe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:16.209665 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-fcf50b47-cbdc-4a60-8961-bc9b0d8eadbe tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1721 microversion: 2.20 time: 0.225511 May 13 14:58:16.210483 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 238/506] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:15 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:17.221976 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f665309c-8685-430c-959b-f022829a4155 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:17.222705 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f665309c-8685-430c-959b-f022829a4155 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:17.229177 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-4a15acd0-a834-4595-b9ce-c4feffc99de6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:17.229799 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-4a15acd0-a834-4595-b9ce-c4feffc99de6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:17.229951 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f665309c-8685-430c-959b-f022829a4155 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:17.230246 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f665309c-8685-430c-959b-f022829a4155 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:17.231417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f665309c-8685-430c-959b-f022829a4155 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:17.231850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f665309c-8685-430c-959b-f022829a4155 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:17.236661 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4a15acd0-a834-4595-b9ce-c4feffc99de6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:17.237146 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4a15acd0-a834-4595-b9ce-c4feffc99de6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:17.237996 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4a15acd0-a834-4595-b9ce-c4feffc99de6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:17.238493 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4a15acd0-a834-4595-b9ce-c4feffc99de6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:17.437957 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f665309c-8685-430c-959b-f022829a4155 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:17.446244 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-4a15acd0-a834-4595-b9ce-c4feffc99de6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:17.448744 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f665309c-8685-430c-959b-f022829a4155 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1722 microversion: 2.1 time: 0.232612 May 13 14:58:17.449493 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 269/507] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:17 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:17.455427 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-4a15acd0-a834-4595-b9ce-c4feffc99de6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:17.457370 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-4a15acd0-a834-4595-b9ce-c4feffc99de6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:17.458555 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-4a15acd0-a834-4595-b9ce-c4feffc99de6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1721 microversion: 2.20 time: 0.233440 May 13 14:58:17.459112 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 239/508] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:17 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:18.045045 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-4c46166e-71a4-4b17-b6d5-76b4517b6747 req-41242e90-542f-4024-a656-be1136162eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96db69fe-6594-486c-96b3-545e6dbfa29b", "name": "network-vif-unplugged", "status": "completed", "tag": "4fd5686b-8efb-4342-9683-06dad26579b5"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:58:18.056409 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-4c46166e-71a4-4b17-b6d5-76b4517b6747 req-41242e90-542f-4024-a656-be1136162eb8 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:18.056825 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-4c46166e-71a4-4b17-b6d5-76b4517b6747 req-41242e90-542f-4024-a656-be1136162eb8 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:18.069222 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-4c46166e-71a4-4b17-b6d5-76b4517b6747 req-41242e90-542f-4024-a656-be1136162eb8 service nova] Creating event network-vif-unplugged:4fd5686b-8efb-4342-9683-06dad26579b5 for instance 96db69fe-6594-486c-96b3-545e6dbfa29b on hv-cinder-83090 May 13 14:58:18.074585 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-4c46166e-71a4-4b17-b6d5-76b4517b6747 req-41242e90-542f-4024-a656-be1136162eb8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033313 May 13 14:58:18.075530 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 270/509] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:58:18.467001 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8047beae-3e74-42fc-84c6-e57a0dc3d09b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:18.467560 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8047beae-3e74-42fc-84c6-e57a0dc3d09b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:18.474801 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8047beae-3e74-42fc-84c6-e57a0dc3d09b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:18.475300 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8047beae-3e74-42fc-84c6-e57a0dc3d09b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:18.476118 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8047beae-3e74-42fc-84c6-e57a0dc3d09b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:18.476569 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8047beae-3e74-42fc-84c6-e57a0dc3d09b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:18.482682 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-b86aeced-e59e-447d-bde9-31ae7cba15f0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:18.483530 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-b86aeced-e59e-447d-bde9-31ae7cba15f0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:18.491170 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b86aeced-e59e-447d-bde9-31ae7cba15f0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:18.491691 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b86aeced-e59e-447d-bde9-31ae7cba15f0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:18.492866 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b86aeced-e59e-447d-bde9-31ae7cba15f0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:18.493516 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b86aeced-e59e-447d-bde9-31ae7cba15f0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:18.678102 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8047beae-3e74-42fc-84c6-e57a0dc3d09b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:18.686475 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8047beae-3e74-42fc-84c6-e57a0dc3d09b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1699 microversion: 2.1 time: 0.223426 May 13 14:58:18.687127 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 240/510] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:18 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1699 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:18.689610 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b86aeced-e59e-447d-bde9-31ae7cba15f0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:18.699157 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b86aeced-e59e-447d-bde9-31ae7cba15f0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:18.700724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b86aeced-e59e-447d-bde9-31ae7cba15f0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:18.701916 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-b86aeced-e59e-447d-bde9-31ae7cba15f0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1721 microversion: 2.20 time: 0.224333 May 13 14:58:18.702601 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 271/511] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:18 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:18.702915 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f48b9957-e9f2-4712-af10-a27698d37673 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:58:18.709156 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f48b9957-e9f2-4712-af10-a27698d37673 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:18.709602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f48b9957-e9f2-4712-af10-a27698d37673 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:18.769097 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f48b9957-e9f2-4712-af10-a27698d37673 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Going to try to start instance {{(pid=117296) start /opt/stack/nova/nova/compute/api.py:2730}} May 13 14:58:18.818213 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f48b9957-e9f2-4712-af10-a27698d37673 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "POST /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/action" status: 202 len: 0 microversion: 2.1 time: 0.118841 May 13 14:58:18.818832 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 241/512] 10.222.0.99 () {60 vars in 1277 bytes} [Fri May 13 14:58:18 2022] POST /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:58:18.826799 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ee92516d-c2d5-4b76-81db-810844e95b55 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:18.827408 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ee92516d-c2d5-4b76-81db-810844e95b55 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:18.840569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ee92516d-c2d5-4b76-81db-810844e95b55 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:18.840569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ee92516d-c2d5-4b76-81db-810844e95b55 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:18.840569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ee92516d-c2d5-4b76-81db-810844e95b55 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:18.840569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ee92516d-c2d5-4b76-81db-810844e95b55 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:18.975098 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ee92516d-c2d5-4b76-81db-810844e95b55 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:18.987308 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ee92516d-c2d5-4b76-81db-810844e95b55 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1708 microversion: 2.1 time: 0.164028 May 13 14:58:18.987982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 272/513] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:18 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1708 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:19.725023 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7562b97d-5719-417d-8504-d51d0d91e369 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:19.726063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7562b97d-5719-417d-8504-d51d0d91e369 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:19.736622 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7562b97d-5719-417d-8504-d51d0d91e369 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:19.737241 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7562b97d-5719-417d-8504-d51d0d91e369 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:19.738421 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7562b97d-5719-417d-8504-d51d0d91e369 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:19.739169 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7562b97d-5719-417d-8504-d51d0d91e369 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:19.886696 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7562b97d-5719-417d-8504-d51d0d91e369 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:19.895227 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7562b97d-5719-417d-8504-d51d0d91e369 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:19.896800 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7562b97d-5719-417d-8504-d51d0d91e369 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:19.897988 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7562b97d-5719-417d-8504-d51d0d91e369 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1721 microversion: 2.20 time: 0.179995 May 13 14:58:19.898556 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 242/514] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:19 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:20.005469 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-7394a678-78c2-43d1-a857-e8cdc3a92c00 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:20.006244 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-7394a678-78c2-43d1-a857-e8cdc3a92c00 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:20.012987 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7394a678-78c2-43d1-a857-e8cdc3a92c00 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:20.013657 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7394a678-78c2-43d1-a857-e8cdc3a92c00 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:20.014651 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7394a678-78c2-43d1-a857-e8cdc3a92c00 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:20.015284 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7394a678-78c2-43d1-a857-e8cdc3a92c00 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:20.159760 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-7394a678-78c2-43d1-a857-e8cdc3a92c00 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:20.168028 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-7394a678-78c2-43d1-a857-e8cdc3a92c00 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1708 microversion: 2.1 time: 0.167037 May 13 14:58:20.168626 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 273/515] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:19 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1708 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:20.916266 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9e2678fe-c0be-4912-9243-ba0c96ac4bf6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:20.916898 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-9e2678fe-c0be-4912-9243-ba0c96ac4bf6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:20.924672 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9e2678fe-c0be-4912-9243-ba0c96ac4bf6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:20.925328 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9e2678fe-c0be-4912-9243-ba0c96ac4bf6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:20.927435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9e2678fe-c0be-4912-9243-ba0c96ac4bf6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:20.927435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9e2678fe-c0be-4912-9243-ba0c96ac4bf6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:21.065401 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9e2678fe-c0be-4912-9243-ba0c96ac4bf6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:21.073522 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9e2678fe-c0be-4912-9243-ba0c96ac4bf6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:21.075049 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9e2678fe-c0be-4912-9243-ba0c96ac4bf6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:21.076219 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9e2678fe-c0be-4912-9243-ba0c96ac4bf6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1724 microversion: 2.20 time: 0.164153 May 13 14:58:21.076780 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 243/516] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:20 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:21.095480 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d5a75665-4ad5-498f-96be-1e7619c9ce6b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a5168c9-b412-4129-8df8-08902fb9d9c9"}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:58:21.096667 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d5a75665-4ad5-498f-96be-1e7619c9ce6b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:21.103345 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d5a75665-4ad5-498f-96be-1e7619c9ce6b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:21.103783 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d5a75665-4ad5-498f-96be-1e7619c9ce6b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:21.104683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d5a75665-4ad5-498f-96be-1e7619c9ce6b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:21.105157 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d5a75665-4ad5-498f-96be-1e7619c9ce6b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:21.185175 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9f5b100f-652c-4ebf-908c-11191bda5cd2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:21.185764 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-9f5b100f-652c-4ebf-908c-11191bda5cd2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:21.192503 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9f5b100f-652c-4ebf-908c-11191bda5cd2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:21.192980 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9f5b100f-652c-4ebf-908c-11191bda5cd2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:21.193766 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9f5b100f-652c-4ebf-908c-11191bda5cd2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:21.194202 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9f5b100f-652c-4ebf-908c-11191bda5cd2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:21.333340 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9f5b100f-652c-4ebf-908c-11191bda5cd2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:21.342559 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9f5b100f-652c-4ebf-908c-11191bda5cd2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1708 microversion: 2.1 time: 0.161237 May 13 14:58:21.343121 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 244/517] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:21 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1708 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:21.415616 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d5a75665-4ad5-498f-96be-1e7619c9ce6b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "POST /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.324426 May 13 14:58:21.416333 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 274/518] 10.222.0.99 () {62 vars in 1363 bytes} [Fri May 13 14:58:21 2022] POST /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:58:21.557076 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c818b3dc-effe-4689-9d55-e21d960ff90b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:58:21.557666 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c818b3dc-effe-4689-9d55-e21d960ff90b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:21.564227 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c818b3dc-effe-4689-9d55-e21d960ff90b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:21.564676 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c818b3dc-effe-4689-9d55-e21d960ff90b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:21.565438 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c818b3dc-effe-4689-9d55-e21d960ff90b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:21.565899 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c818b3dc-effe-4689-9d55-e21d960ff90b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:21.668179 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c818b3dc-effe-4689-9d55-e21d960ff90b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "POST /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/action" status: 202 len: 0 microversion: 2.20 time: 0.115085 May 13 14:58:21.668813 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 245/519] 10.222.0.99 () {62 vars in 1318 bytes} [Fri May 13 14:58:21 2022] POST /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 14:58:21.677187 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e501703c-b680-429a-b211-85f321157d48 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:21.678001 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e501703c-b680-429a-b211-85f321157d48 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:21.685287 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e501703c-b680-429a-b211-85f321157d48 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:21.685737 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e501703c-b680-429a-b211-85f321157d48 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:21.686492 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e501703c-b680-429a-b211-85f321157d48 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:21.686925 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e501703c-b680-429a-b211-85f321157d48 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:21.826959 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e501703c-b680-429a-b211-85f321157d48 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:21.837825 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e501703c-b680-429a-b211-85f321157d48 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:21.839454 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e501703c-b680-429a-b211-85f321157d48 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:21.840914 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e501703c-b680-429a-b211-85f321157d48 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1750 microversion: 2.20 time: 0.167794 May 13 14:58:21.841549 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 275/520] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:21 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:22.171395 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9d0fa4ad-f535-4bb6-989f-daaa0339f743 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:22.171900 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-9d0fa4ad-f535-4bb6-989f-daaa0339f743 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:22.178598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9d0fa4ad-f535-4bb6-989f-daaa0339f743 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:22.179087 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9d0fa4ad-f535-4bb6-989f-daaa0339f743 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:22.179852 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9d0fa4ad-f535-4bb6-989f-daaa0339f743 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:22.180314 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9d0fa4ad-f535-4bb6-989f-daaa0339f743 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:22.309216 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-9d0fa4ad-f535-4bb6-989f-daaa0339f743 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'services' on Instance uuid fa4062d3-a547-4be9-b840-e5f9a4ca1205 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:58:22.361808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e2ce5597-3cfa-424e-ae1c-e574f94d961a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:22.363265 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e2ce5597-3cfa-424e-ae1c-e574f94d961a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:22.371040 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e2ce5597-3cfa-424e-ae1c-e574f94d961a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:22.371830 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e2ce5597-3cfa-424e-ae1c-e574f94d961a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:22.372788 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e2ce5597-3cfa-424e-ae1c-e574f94d961a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:22.373381 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e2ce5597-3cfa-424e-ae1c-e574f94d961a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:22.430912 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9d0fa4ad-f535-4bb6-989f-daaa0339f743 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "DELETE /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205/os-volume_attachments/8e362dfe-5310-4fc8-b9bd-0b40f6f8c841" status: 202 len: 0 microversion: 2.1 time: 0.264079 May 13 14:58:22.431544 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 246/521] 10.222.0.99 () {58 vars in 1415 bytes} [Fri May 13 14:58:22 2022] DELETE /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205/os-volume_attachments/8e362dfe-5310-4fc8-b9bd-0b40f6f8c841 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:58:22.552942 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e2ce5597-3cfa-424e-ae1c-e574f94d961a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:22.568113 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e2ce5597-3cfa-424e-ae1c-e574f94d961a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1708 microversion: 2.1 time: 0.210632 May 13 14:58:22.577876 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 276/522] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:22 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1708 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:58:22.861001 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3cac08e8-ec37-49bf-8746-18f11e196e4d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:22.861597 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-3cac08e8-ec37-49bf-8746-18f11e196e4d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:22.868298 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3cac08e8-ec37-49bf-8746-18f11e196e4d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:22.868732 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3cac08e8-ec37-49bf-8746-18f11e196e4d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:22.869520 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3cac08e8-ec37-49bf-8746-18f11e196e4d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:22.869947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3cac08e8-ec37-49bf-8746-18f11e196e4d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:23.022497 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3cac08e8-ec37-49bf-8746-18f11e196e4d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:23.031647 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3cac08e8-ec37-49bf-8746-18f11e196e4d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:23.033165 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3cac08e8-ec37-49bf-8746-18f11e196e4d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:23.034289 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-3cac08e8-ec37-49bf-8746-18f11e196e4d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1750 microversion: 2.20 time: 0.178252 May 13 14:58:23.034875 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 247/523] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:22 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1750 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:23.585660 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-de17207f-1b3c-4665-968b-0a9a560f2c60 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:23.586403 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-de17207f-1b3c-4665-968b-0a9a560f2c60 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:23.592993 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-de17207f-1b3c-4665-968b-0a9a560f2c60 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:23.593443 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-de17207f-1b3c-4665-968b-0a9a560f2c60 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:23.594223 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-de17207f-1b3c-4665-968b-0a9a560f2c60 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:23.594651 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-de17207f-1b3c-4665-968b-0a9a560f2c60 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:23.734371 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-de17207f-1b3c-4665-968b-0a9a560f2c60 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:23.742483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-de17207f-1b3c-4665-968b-0a9a560f2c60 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1712 microversion: 2.1 time: 0.160852 May 13 14:58:23.743053 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 277/524] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:23 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1712 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:24.056385 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b5516eab-986f-4cc5-a195-2706dab1d5c4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:24.057065 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b5516eab-986f-4cc5-a195-2706dab1d5c4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:24.063851 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b5516eab-986f-4cc5-a195-2706dab1d5c4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:24.064317 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b5516eab-986f-4cc5-a195-2706dab1d5c4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:24.065073 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b5516eab-986f-4cc5-a195-2706dab1d5c4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:24.065497 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b5516eab-986f-4cc5-a195-2706dab1d5c4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:24.209008 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b5516eab-986f-4cc5-a195-2706dab1d5c4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:24.217679 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b5516eab-986f-4cc5-a195-2706dab1d5c4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:24.219170 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b5516eab-986f-4cc5-a195-2706dab1d5c4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:24.220405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b5516eab-986f-4cc5-a195-2706dab1d5c4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1752 microversion: 2.20 time: 0.170411 May 13 14:58:24.221033 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 248/525] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:24 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:24.619273 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-0264baac-9808-4eba-883b-661ccc067b7d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:24.619809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-0264baac-9808-4eba-883b-661ccc067b7d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:24.626632 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0264baac-9808-4eba-883b-661ccc067b7d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:24.627094 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0264baac-9808-4eba-883b-661ccc067b7d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:24.627907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0264baac-9808-4eba-883b-661ccc067b7d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:24.628349 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0264baac-9808-4eba-883b-661ccc067b7d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:24.656013 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-0264baac-9808-4eba-883b-661ccc067b7d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Going to try to terminate instance {{(pid=117295) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:58:24.738351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-0264baac-9808-4eba-883b-661ccc067b7d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "DELETE /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 204 len: 0 microversion: 2.1 time: 0.123361 May 13 14:58:24.738945 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 278/526] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 14:58:24 2022] DELETE /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:58:24.747179 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-422ec816-8517-4185-ac58-29a8ded8793c tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:24.747810 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-422ec816-8517-4185-ac58-29a8ded8793c tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:24.753914 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-422ec816-8517-4185-ac58-29a8ded8793c tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:24.754365 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-422ec816-8517-4185-ac58-29a8ded8793c tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:24.755136 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-422ec816-8517-4185-ac58-29a8ded8793c tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:24.755570 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-422ec816-8517-4185-ac58-29a8ded8793c tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:24.900238 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-422ec816-8517-4185-ac58-29a8ded8793c tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:24.908060 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-422ec816-8517-4185-ac58-29a8ded8793c tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1514 microversion: 2.1 time: 0.164700 May 13 14:58:24.908633 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 249/527] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:24 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:25.241013 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-54060b72-c94f-424a-a6df-c2e36ab72fa0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:25.241867 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-54060b72-c94f-424a-a6df-c2e36ab72fa0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:25.249976 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-54060b72-c94f-424a-a6df-c2e36ab72fa0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:25.250525 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-54060b72-c94f-424a-a6df-c2e36ab72fa0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:25.251472 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-54060b72-c94f-424a-a6df-c2e36ab72fa0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:25.252041 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-54060b72-c94f-424a-a6df-c2e36ab72fa0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:25.389474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-54060b72-c94f-424a-a6df-c2e36ab72fa0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:25.402960 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-54060b72-c94f-424a-a6df-c2e36ab72fa0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:25.404471 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-54060b72-c94f-424a-a6df-c2e36ab72fa0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:25.405624 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-54060b72-c94f-424a-a6df-c2e36ab72fa0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.170067 May 13 14:58:25.406183 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 279/528] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:25 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:25.934991 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-4432a0d6-136f-4be6-a133-5d633b255d77 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:25.935862 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-4432a0d6-136f-4be6-a133-5d633b255d77 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:25.945447 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4432a0d6-136f-4be6-a133-5d633b255d77 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:25.946048 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4432a0d6-136f-4be6-a133-5d633b255d77 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:25.947063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4432a0d6-136f-4be6-a133-5d633b255d77 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:25.947634 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4432a0d6-136f-4be6-a133-5d633b255d77 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:26.099922 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-4432a0d6-136f-4be6-a133-5d633b255d77 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:26.108218 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-4432a0d6-136f-4be6-a133-5d633b255d77 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1514 microversion: 2.1 time: 0.179938 May 13 14:58:26.108789 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 250/529] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:25 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:26.428696 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9295febf-2e93-4106-8180-3f1087642670 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:26.429651 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9295febf-2e93-4106-8180-3f1087642670 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:26.438331 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9295febf-2e93-4106-8180-3f1087642670 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:26.438837 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9295febf-2e93-4106-8180-3f1087642670 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:26.439614 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9295febf-2e93-4106-8180-3f1087642670 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:26.440095 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9295febf-2e93-4106-8180-3f1087642670 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:26.578683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9295febf-2e93-4106-8180-3f1087642670 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:26.587560 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9295febf-2e93-4106-8180-3f1087642670 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:26.589095 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9295febf-2e93-4106-8180-3f1087642670 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:26.590518 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9295febf-2e93-4106-8180-3f1087642670 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.168319 May 13 14:58:26.591324 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 280/530] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:26 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:27.130433 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-80b55534-9ec6-45b2-82e9-699a7f53805f tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:27.131033 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-80b55534-9ec6-45b2-82e9-699a7f53805f tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:27.138341 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-80b55534-9ec6-45b2-82e9-699a7f53805f tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:27.138782 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-80b55534-9ec6-45b2-82e9-699a7f53805f tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:27.139595 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-80b55534-9ec6-45b2-82e9-699a7f53805f tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:27.140069 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-80b55534-9ec6-45b2-82e9-699a7f53805f tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:27.279958 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-80b55534-9ec6-45b2-82e9-699a7f53805f tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:27.287586 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-80b55534-9ec6-45b2-82e9-699a7f53805f tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1514 microversion: 2.1 time: 0.161223 May 13 14:58:27.288262 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 251/531] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:27 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:27.609366 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e1150ac1-6bab-40f2-9f67-2621119fb306 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:27.609990 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e1150ac1-6bab-40f2-9f67-2621119fb306 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:27.616827 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e1150ac1-6bab-40f2-9f67-2621119fb306 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:27.617273 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e1150ac1-6bab-40f2-9f67-2621119fb306 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:27.618281 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e1150ac1-6bab-40f2-9f67-2621119fb306 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:27.618717 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e1150ac1-6bab-40f2-9f67-2621119fb306 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:27.748223 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-b367ed40-9bd4-4588-8a4d-8d33ae316572 req-34adc6ac-3bc9-43d6-a27c-b1e064a5bc80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa4062d3-a547-4be9-b840-e5f9a4ca1205", "name": "network-vif-deleted", "tag": "99ba8426-1b1e-44a7-8c7d-58c7127f89ae"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:58:27.756637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-b367ed40-9bd4-4588-8a4d-8d33ae316572 req-34adc6ac-3bc9-43d6-a27c-b1e064a5bc80 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:27.757429 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-b367ed40-9bd4-4588-8a4d-8d33ae316572 req-34adc6ac-3bc9-43d6-a27c-b1e064a5bc80 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:27.769638 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-b367ed40-9bd4-4588-8a4d-8d33ae316572 req-34adc6ac-3bc9-43d6-a27c-b1e064a5bc80 service nova] Creating event network-vif-deleted:99ba8426-1b1e-44a7-8c7d-58c7127f89ae for instance fa4062d3-a547-4be9-b840-e5f9a4ca1205 on hv-cinder-83090 May 13 14:58:27.774920 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-b367ed40-9bd4-4588-8a4d-8d33ae316572 req-34adc6ac-3bc9-43d6-a27c-b1e064a5bc80 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031473 May 13 14:58:27.775728 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 252/532] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:58:27.776363 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e1150ac1-6bab-40f2-9f67-2621119fb306 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:27.785588 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e1150ac1-6bab-40f2-9f67-2621119fb306 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:27.787085 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e1150ac1-6bab-40f2-9f67-2621119fb306 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:27.788295 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e1150ac1-6bab-40f2-9f67-2621119fb306 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.183342 May 13 14:58:27.788878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 281/533] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:27 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:28.306567 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-30c35c79-f153-4ce2-94a3-e4981bda5bcd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:28.307261 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-30c35c79-f153-4ce2-94a3-e4981bda5bcd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:28.313762 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-30c35c79-f153-4ce2-94a3-e4981bda5bcd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:28.314209 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-30c35c79-f153-4ce2-94a3-e4981bda5bcd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:28.314979 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-30c35c79-f153-4ce2-94a3-e4981bda5bcd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:28.315417 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-30c35c79-f153-4ce2-94a3-e4981bda5bcd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:28.350268 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-30c35c79-f153-4ce2-94a3-e4981bda5bcd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:28.350720 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-30c35c79-f153-4ce2-94a3-e4981bda5bcd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:28.351167 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-30c35c79-f153-4ce2-94a3-e4981bda5bcd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'fault' on Instance uuid fa4062d3-a547-4be9-b840-e5f9a4ca1205 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:58:28.406350 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-30c35c79-f153-4ce2-94a3-e4981bda5bcd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:28.415552 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-30c35c79-f153-4ce2-94a3-e4981bda5bcd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1309 microversion: 2.1 time: 0.113966 May 13 14:58:28.416147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 253/534] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:28 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1309 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:28.815095 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-8ce36ed3-a51e-4b7c-ac63-8f16a6f0e7ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:28.815676 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-8ce36ed3-a51e-4b7c-ac63-8f16a6f0e7ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:28.822253 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8ce36ed3-a51e-4b7c-ac63-8f16a6f0e7ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:28.822706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8ce36ed3-a51e-4b7c-ac63-8f16a6f0e7ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:28.823469 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8ce36ed3-a51e-4b7c-ac63-8f16a6f0e7ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:28.823898 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8ce36ed3-a51e-4b7c-ac63-8f16a6f0e7ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:28.964352 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-8ce36ed3-a51e-4b7c-ac63-8f16a6f0e7ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:28.974091 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-8ce36ed3-a51e-4b7c-ac63-8f16a6f0e7ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:28.975654 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-8ce36ed3-a51e-4b7c-ac63-8f16a6f0e7ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:28.976961 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-8ce36ed3-a51e-4b7c-ac63-8f16a6f0e7ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.166027 May 13 14:58:28.977857 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 282/535] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:28 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:29.437273 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6c872dfc-5ab5-4de9-85c4-889cb712f5db tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:29.438094 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6c872dfc-5ab5-4de9-85c4-889cb712f5db tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:29.447730 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6c872dfc-5ab5-4de9-85c4-889cb712f5db tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:29.448373 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6c872dfc-5ab5-4de9-85c4-889cb712f5db tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:29.449499 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6c872dfc-5ab5-4de9-85c4-889cb712f5db tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:29.450158 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6c872dfc-5ab5-4de9-85c4-889cb712f5db tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:29.485798 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6c872dfc-5ab5-4de9-85c4-889cb712f5db tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:29.486246 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6c872dfc-5ab5-4de9-85c4-889cb712f5db tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:29.487077 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-6c872dfc-5ab5-4de9-85c4-889cb712f5db tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'fault' on Instance uuid fa4062d3-a547-4be9-b840-e5f9a4ca1205 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:58:29.535017 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6c872dfc-5ab5-4de9-85c4-889cb712f5db tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:29.544173 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6c872dfc-5ab5-4de9-85c4-889cb712f5db tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1309 microversion: 2.1 time: 0.113220 May 13 14:58:29.547968 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 254/536] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:29 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:29.997875 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-b2c11f65-380c-49f8-9cb2-ff05b81b837b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:29.998413 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-b2c11f65-380c-49f8-9cb2-ff05b81b837b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:30.005566 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b2c11f65-380c-49f8-9cb2-ff05b81b837b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:30.006046 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b2c11f65-380c-49f8-9cb2-ff05b81b837b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:30.006934 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b2c11f65-380c-49f8-9cb2-ff05b81b837b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:30.007371 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b2c11f65-380c-49f8-9cb2-ff05b81b837b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:30.150701 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b2c11f65-380c-49f8-9cb2-ff05b81b837b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:30.159888 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b2c11f65-380c-49f8-9cb2-ff05b81b837b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:30.161479 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b2c11f65-380c-49f8-9cb2-ff05b81b837b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:30.162951 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-b2c11f65-380c-49f8-9cb2-ff05b81b837b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.168941 May 13 14:58:30.175859 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 283/537] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:29 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:30.562950 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-bd481931-8556-4c6c-bad4-db3bcd84accd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:30.563655 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-bd481931-8556-4c6c-bad4-db3bcd84accd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:30.570328 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bd481931-8556-4c6c-bad4-db3bcd84accd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:30.570775 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bd481931-8556-4c6c-bad4-db3bcd84accd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:30.571549 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bd481931-8556-4c6c-bad4-db3bcd84accd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:30.572013 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bd481931-8556-4c6c-bad4-db3bcd84accd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:30.607646 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bd481931-8556-4c6c-bad4-db3bcd84accd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:30.608147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bd481931-8556-4c6c-bad4-db3bcd84accd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:30.608601 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-bd481931-8556-4c6c-bad4-db3bcd84accd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'fault' on Instance uuid fa4062d3-a547-4be9-b840-e5f9a4ca1205 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:58:30.653021 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-bd481931-8556-4c6c-bad4-db3bcd84accd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:30.661262 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-bd481931-8556-4c6c-bad4-db3bcd84accd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1309 microversion: 2.1 time: 0.102978 May 13 14:58:30.662064 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 255/538] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:30 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:31.185980 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ec4ff8f1-dfbd-4cd5-a4e3-3e382140ecad tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:31.187357 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ec4ff8f1-dfbd-4cd5-a4e3-3e382140ecad tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:31.199189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ec4ff8f1-dfbd-4cd5-a4e3-3e382140ecad tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:31.199968 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ec4ff8f1-dfbd-4cd5-a4e3-3e382140ecad tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:31.201235 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ec4ff8f1-dfbd-4cd5-a4e3-3e382140ecad tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:31.202005 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ec4ff8f1-dfbd-4cd5-a4e3-3e382140ecad tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:31.337288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ec4ff8f1-dfbd-4cd5-a4e3-3e382140ecad tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:31.345930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ec4ff8f1-dfbd-4cd5-a4e3-3e382140ecad tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:31.347448 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ec4ff8f1-dfbd-4cd5-a4e3-3e382140ecad tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:31.348644 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ec4ff8f1-dfbd-4cd5-a4e3-3e382140ecad tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.169511 May 13 14:58:31.349202 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 284/539] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:31 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:58:31.679764 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-fdd05e17-6453-4d2c-8500-94e01f8d3d7b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:31.681717 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-fdd05e17-6453-4d2c-8500-94e01f8d3d7b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:31.691148 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-fdd05e17-6453-4d2c-8500-94e01f8d3d7b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:31.691724 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-fdd05e17-6453-4d2c-8500-94e01f8d3d7b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:31.692800 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-fdd05e17-6453-4d2c-8500-94e01f8d3d7b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:31.693370 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-fdd05e17-6453-4d2c-8500-94e01f8d3d7b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:31.730711 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-fdd05e17-6453-4d2c-8500-94e01f8d3d7b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:31.731456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-fdd05e17-6453-4d2c-8500-94e01f8d3d7b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:31.731956 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-fdd05e17-6453-4d2c-8500-94e01f8d3d7b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'fault' on Instance uuid fa4062d3-a547-4be9-b840-e5f9a4ca1205 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:58:31.776279 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-fdd05e17-6453-4d2c-8500-94e01f8d3d7b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:31.783734 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-fdd05e17-6453-4d2c-8500-94e01f8d3d7b tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1309 microversion: 2.1 time: 0.108704 May 13 14:58:31.784346 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 256/540] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:31 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:32.368406 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-041a1d52-1f9b-47d9-8733-88936711d476 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:32.369118 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-041a1d52-1f9b-47d9-8733-88936711d476 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:32.376111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-041a1d52-1f9b-47d9-8733-88936711d476 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:32.376588 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-041a1d52-1f9b-47d9-8733-88936711d476 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:32.377393 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-041a1d52-1f9b-47d9-8733-88936711d476 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:32.377803 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-041a1d52-1f9b-47d9-8733-88936711d476 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:32.527610 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-041a1d52-1f9b-47d9-8733-88936711d476 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:32.537781 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-041a1d52-1f9b-47d9-8733-88936711d476 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:32.539280 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-041a1d52-1f9b-47d9-8733-88936711d476 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:32.540801 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-041a1d52-1f9b-47d9-8733-88936711d476 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.176533 May 13 14:58:32.541563 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 285/541] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:32 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:32.802236 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9757e5b5-e04d-4593-9ef0-16bd355a8a94 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:32.802918 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-9757e5b5-e04d-4593-9ef0-16bd355a8a94 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:32.810181 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9757e5b5-e04d-4593-9ef0-16bd355a8a94 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:32.810621 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9757e5b5-e04d-4593-9ef0-16bd355a8a94 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:32.811408 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9757e5b5-e04d-4593-9ef0-16bd355a8a94 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:32.811834 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9757e5b5-e04d-4593-9ef0-16bd355a8a94 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:32.843747 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9757e5b5-e04d-4593-9ef0-16bd355a8a94 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:32.844304 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9757e5b5-e04d-4593-9ef0-16bd355a8a94 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:32.844776 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-9757e5b5-e04d-4593-9ef0-16bd355a8a94 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'fault' on Instance uuid fa4062d3-a547-4be9-b840-e5f9a4ca1205 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:58:32.889482 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9757e5b5-e04d-4593-9ef0-16bd355a8a94 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:32.910179 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9757e5b5-e04d-4593-9ef0-16bd355a8a94 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1309 microversion: 2.1 time: 0.112501 May 13 14:58:32.910875 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 257/542] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:32 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:33.561264 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-946cbcc1-0913-4c8e-aa07-ad4d28f49f21 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:33.562223 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-946cbcc1-0913-4c8e-aa07-ad4d28f49f21 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:33.569632 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-946cbcc1-0913-4c8e-aa07-ad4d28f49f21 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:33.570091 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-946cbcc1-0913-4c8e-aa07-ad4d28f49f21 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:33.570881 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-946cbcc1-0913-4c8e-aa07-ad4d28f49f21 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:33.571318 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-946cbcc1-0913-4c8e-aa07-ad4d28f49f21 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:33.710489 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-946cbcc1-0913-4c8e-aa07-ad4d28f49f21 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:33.720009 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-946cbcc1-0913-4c8e-aa07-ad4d28f49f21 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:33.721498 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-946cbcc1-0913-4c8e-aa07-ad4d28f49f21 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:33.722698 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-946cbcc1-0913-4c8e-aa07-ad4d28f49f21 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.166014 May 13 14:58:33.729833 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 286/543] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:33 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:33.928273 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9f189a8e-e19c-437d-8966-ccf7763f98b9 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:33.928889 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-9f189a8e-e19c-437d-8966-ccf7763f98b9 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:33.935185 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9f189a8e-e19c-437d-8966-ccf7763f98b9 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:33.935660 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9f189a8e-e19c-437d-8966-ccf7763f98b9 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:33.936417 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9f189a8e-e19c-437d-8966-ccf7763f98b9 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:33.936847 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9f189a8e-e19c-437d-8966-ccf7763f98b9 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:33.968786 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9f189a8e-e19c-437d-8966-ccf7763f98b9 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:33.969287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9f189a8e-e19c-437d-8966-ccf7763f98b9 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:33.969836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-9f189a8e-e19c-437d-8966-ccf7763f98b9 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'fault' on Instance uuid fa4062d3-a547-4be9-b840-e5f9a4ca1205 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:58:34.014620 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9f189a8e-e19c-437d-8966-ccf7763f98b9 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:34.022635 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9f189a8e-e19c-437d-8966-ccf7763f98b9 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1309 microversion: 2.1 time: 0.098347 May 13 14:58:34.023214 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 258/544] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:33 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:34.742899 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-aa177a7f-181b-4e9c-b49f-e4b736abe893 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:34.743544 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-aa177a7f-181b-4e9c-b49f-e4b736abe893 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:34.750405 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-aa177a7f-181b-4e9c-b49f-e4b736abe893 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:34.750860 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-aa177a7f-181b-4e9c-b49f-e4b736abe893 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:34.751719 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-aa177a7f-181b-4e9c-b49f-e4b736abe893 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:34.752219 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-aa177a7f-181b-4e9c-b49f-e4b736abe893 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:34.900725 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-aa177a7f-181b-4e9c-b49f-e4b736abe893 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:34.911732 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-aa177a7f-181b-4e9c-b49f-e4b736abe893 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:34.913278 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-aa177a7f-181b-4e9c-b49f-e4b736abe893 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:34.914484 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-aa177a7f-181b-4e9c-b49f-e4b736abe893 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.175647 May 13 14:58:34.915054 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 287/545] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:34 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:35.040221 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5d543554-e95b-4ea2-acd0-40541d67f595 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:35.040815 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5d543554-e95b-4ea2-acd0-40541d67f595 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:35.047361 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5d543554-e95b-4ea2-acd0-40541d67f595 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:35.047839 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5d543554-e95b-4ea2-acd0-40541d67f595 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:35.048607 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5d543554-e95b-4ea2-acd0-40541d67f595 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:35.049079 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5d543554-e95b-4ea2-acd0-40541d67f595 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:35.081244 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5d543554-e95b-4ea2-acd0-40541d67f595 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:35.082401 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5d543554-e95b-4ea2-acd0-40541d67f595 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:35.082816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-5d543554-e95b-4ea2-acd0-40541d67f595 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'fault' on Instance uuid fa4062d3-a547-4be9-b840-e5f9a4ca1205 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:58:35.125592 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5d543554-e95b-4ea2-acd0-40541d67f595 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:35.135302 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5d543554-e95b-4ea2-acd0-40541d67f595 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1309 microversion: 2.1 time: 0.098947 May 13 14:58:35.136235 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 259/546] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:35 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:35.933305 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f23a6981-6d2e-43ce-93e5-56cc86ef2fcd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:35.933965 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f23a6981-6d2e-43ce-93e5-56cc86ef2fcd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:35.943071 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f23a6981-6d2e-43ce-93e5-56cc86ef2fcd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:35.943609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f23a6981-6d2e-43ce-93e5-56cc86ef2fcd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:35.944446 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f23a6981-6d2e-43ce-93e5-56cc86ef2fcd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:35.944883 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f23a6981-6d2e-43ce-93e5-56cc86ef2fcd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:36.083787 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f23a6981-6d2e-43ce-93e5-56cc86ef2fcd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:36.092992 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f23a6981-6d2e-43ce-93e5-56cc86ef2fcd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:36.094504 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f23a6981-6d2e-43ce-93e5-56cc86ef2fcd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:36.095674 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f23a6981-6d2e-43ce-93e5-56cc86ef2fcd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.166620 May 13 14:58:36.096269 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 288/547] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:35 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:58:36.152748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6e9f80be-5cc2-4e37-b4b5-3bde9270d266 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:36.153383 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6e9f80be-5cc2-4e37-b4b5-3bde9270d266 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:36.160569 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e9f80be-5cc2-4e37-b4b5-3bde9270d266 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:36.161012 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e9f80be-5cc2-4e37-b4b5-3bde9270d266 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:36.161838 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e9f80be-5cc2-4e37-b4b5-3bde9270d266 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:36.162467 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e9f80be-5cc2-4e37-b4b5-3bde9270d266 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:36.195418 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e9f80be-5cc2-4e37-b4b5-3bde9270d266 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:36.195762 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e9f80be-5cc2-4e37-b4b5-3bde9270d266 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:36.196238 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-6e9f80be-5cc2-4e37-b4b5-3bde9270d266 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'fault' on Instance uuid fa4062d3-a547-4be9-b840-e5f9a4ca1205 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:58:36.241438 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6e9f80be-5cc2-4e37-b4b5-3bde9270d266 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:36.251023 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6e9f80be-5cc2-4e37-b4b5-3bde9270d266 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1309 microversion: 2.1 time: 0.102183 May 13 14:58:36.251814 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 260/548] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:36 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:37.115269 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e060142e-c8a3-494d-b339-cb3eb4c62dee tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:37.115989 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e060142e-c8a3-494d-b339-cb3eb4c62dee tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:37.122701 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e060142e-c8a3-494d-b339-cb3eb4c62dee tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:37.123148 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e060142e-c8a3-494d-b339-cb3eb4c62dee tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:37.123955 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e060142e-c8a3-494d-b339-cb3eb4c62dee tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:37.124392 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e060142e-c8a3-494d-b339-cb3eb4c62dee tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:37.268916 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-265b39c7-7a01-4526-8db3-1e7e72ffb559 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:37.270317 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-265b39c7-7a01-4526-8db3-1e7e72ffb559 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:37.270891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e060142e-c8a3-494d-b339-cb3eb4c62dee tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:37.277531 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-265b39c7-7a01-4526-8db3-1e7e72ffb559 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:37.278499 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-265b39c7-7a01-4526-8db3-1e7e72ffb559 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:37.279357 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-265b39c7-7a01-4526-8db3-1e7e72ffb559 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:37.279856 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-265b39c7-7a01-4526-8db3-1e7e72ffb559 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:37.280350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e060142e-c8a3-494d-b339-cb3eb4c62dee tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:37.281868 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e060142e-c8a3-494d-b339-cb3eb4c62dee tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:37.283029 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e060142e-c8a3-494d-b339-cb3eb4c62dee tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.171981 May 13 14:58:37.283747 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 289/549] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:37 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:37.312570 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-265b39c7-7a01-4526-8db3-1e7e72ffb559 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:37.313015 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-265b39c7-7a01-4526-8db3-1e7e72ffb559 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:37.313466 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-265b39c7-7a01-4526-8db3-1e7e72ffb559 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'fault' on Instance uuid fa4062d3-a547-4be9-b840-e5f9a4ca1205 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:58:37.363739 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-265b39c7-7a01-4526-8db3-1e7e72ffb559 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:37.371214 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-265b39c7-7a01-4526-8db3-1e7e72ffb559 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1309 microversion: 2.1 time: 0.106200 May 13 14:58:37.371723 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 261/550] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:37 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:38.301437 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-a0545004-2ff1-4632-b21e-38b4fd67bdda tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:38.302069 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-a0545004-2ff1-4632-b21e-38b4fd67bdda tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:38.308776 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a0545004-2ff1-4632-b21e-38b4fd67bdda tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:38.309216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a0545004-2ff1-4632-b21e-38b4fd67bdda tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:38.309976 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a0545004-2ff1-4632-b21e-38b4fd67bdda tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:38.310401 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a0545004-2ff1-4632-b21e-38b4fd67bdda tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:38.388708 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a739cce6-80ab-4e3e-a47b-b5f0d1ea6573 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:38.389121 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a739cce6-80ab-4e3e-a47b-b5f0d1ea6573 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:38.395448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a739cce6-80ab-4e3e-a47b-b5f0d1ea6573 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:38.395908 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a739cce6-80ab-4e3e-a47b-b5f0d1ea6573 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:38.396680 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a739cce6-80ab-4e3e-a47b-b5f0d1ea6573 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:38.397104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a739cce6-80ab-4e3e-a47b-b5f0d1ea6573 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:38.431519 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a739cce6-80ab-4e3e-a47b-b5f0d1ea6573 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:38.432000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a739cce6-80ab-4e3e-a47b-b5f0d1ea6573 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:38.432462 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-a739cce6-80ab-4e3e-a47b-b5f0d1ea6573 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'fault' on Instance uuid fa4062d3-a547-4be9-b840-e5f9a4ca1205 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:58:38.441799 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-a0545004-2ff1-4632-b21e-38b4fd67bdda tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:38.451138 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-a0545004-2ff1-4632-b21e-38b4fd67bdda tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:38.452751 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-a0545004-2ff1-4632-b21e-38b4fd67bdda tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:38.454145 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-a0545004-2ff1-4632-b21e-38b4fd67bdda tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.156866 May 13 14:58:38.465375 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 290/551] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:38 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:38.477845 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-a739cce6-80ab-4e3e-a47b-b5f0d1ea6573 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:38.486165 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a739cce6-80ab-4e3e-a47b-b5f0d1ea6573 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1309 microversion: 2.1 time: 0.101641 May 13 14:58:38.486932 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 262/552] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:38 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:39.474603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ea2e55ea-f1bf-4bb4-9737-757bcb6aed4e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:39.475523 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ea2e55ea-f1bf-4bb4-9737-757bcb6aed4e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:39.482448 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ea2e55ea-f1bf-4bb4-9737-757bcb6aed4e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:39.482888 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ea2e55ea-f1bf-4bb4-9737-757bcb6aed4e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:39.483673 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ea2e55ea-f1bf-4bb4-9737-757bcb6aed4e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:39.484142 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ea2e55ea-f1bf-4bb4-9737-757bcb6aed4e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:39.503539 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-786ca24e-7023-4cd7-afc4-99cdd15375b5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:39.504976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-786ca24e-7023-4cd7-afc4-99cdd15375b5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:39.518195 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-786ca24e-7023-4cd7-afc4-99cdd15375b5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:39.519007 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-786ca24e-7023-4cd7-afc4-99cdd15375b5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:39.520211 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-786ca24e-7023-4cd7-afc4-99cdd15375b5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:39.520896 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-786ca24e-7023-4cd7-afc4-99cdd15375b5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:39.559748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-786ca24e-7023-4cd7-afc4-99cdd15375b5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:39.560333 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-786ca24e-7023-4cd7-afc4-99cdd15375b5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:39.560890 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-786ca24e-7023-4cd7-afc4-99cdd15375b5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'fault' on Instance uuid fa4062d3-a547-4be9-b840-e5f9a4ca1205 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:58:39.620315 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-786ca24e-7023-4cd7-afc4-99cdd15375b5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:39.627834 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-786ca24e-7023-4cd7-afc4-99cdd15375b5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1309 microversion: 2.1 time: 0.128015 May 13 14:58:39.628651 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 263/553] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:39 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1309 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:58:39.642660 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ea2e55ea-f1bf-4bb4-9737-757bcb6aed4e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:39.651602 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ea2e55ea-f1bf-4bb4-9737-757bcb6aed4e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:39.653165 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ea2e55ea-f1bf-4bb4-9737-757bcb6aed4e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:39.654347 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ea2e55ea-f1bf-4bb4-9737-757bcb6aed4e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.185241 May 13 14:58:39.654944 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 291/554] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:39 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:40.645628 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9dcdf925-e370-45b8-8330-f50a8360f440 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:40.646264 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-9dcdf925-e370-45b8-8330-f50a8360f440 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:40.653296 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9dcdf925-e370-45b8-8330-f50a8360f440 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:40.653723 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9dcdf925-e370-45b8-8330-f50a8360f440 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:40.654544 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9dcdf925-e370-45b8-8330-f50a8360f440 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:40.654983 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9dcdf925-e370-45b8-8330-f50a8360f440 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:40.674940 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-15f9edfe-9a9c-428d-9413-d7e876036745 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:40.676382 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-15f9edfe-9a9c-428d-9413-d7e876036745 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:40.684145 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-15f9edfe-9a9c-428d-9413-d7e876036745 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:40.684591 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-15f9edfe-9a9c-428d-9413-d7e876036745 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:40.685560 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-15f9edfe-9a9c-428d-9413-d7e876036745 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:40.685990 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-15f9edfe-9a9c-428d-9413-d7e876036745 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:40.688047 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9dcdf925-e370-45b8-8330-f50a8360f440 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:40.688529 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9dcdf925-e370-45b8-8330-f50a8360f440 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:40.688977 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-9dcdf925-e370-45b8-8330-f50a8360f440 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'fault' on Instance uuid fa4062d3-a547-4be9-b840-e5f9a4ca1205 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:58:40.739602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9dcdf925-e370-45b8-8330-f50a8360f440 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:40.748813 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9dcdf925-e370-45b8-8330-f50a8360f440 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1309 microversion: 2.1 time: 0.107364 May 13 14:58:40.749639 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 264/555] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:40 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:40.826692 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-15f9edfe-9a9c-428d-9413-d7e876036745 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:40.835595 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-15f9edfe-9a9c-428d-9413-d7e876036745 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:40.837484 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-15f9edfe-9a9c-428d-9413-d7e876036745 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:40.838657 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-15f9edfe-9a9c-428d-9413-d7e876036745 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.169433 May 13 14:58:40.839214 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 292/556] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:40 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:41.769171 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b6b12d69-b463-4880-96b8-c99d158488e3 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:41.769998 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b6b12d69-b463-4880-96b8-c99d158488e3 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:41.778428 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b6b12d69-b463-4880-96b8-c99d158488e3 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:41.778879 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b6b12d69-b463-4880-96b8-c99d158488e3 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:41.779653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b6b12d69-b463-4880-96b8-c99d158488e3 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:41.780133 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b6b12d69-b463-4880-96b8-c99d158488e3 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:41.811894 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b6b12d69-b463-4880-96b8-c99d158488e3 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:41.812369 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b6b12d69-b463-4880-96b8-c99d158488e3 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:41.812823 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-b6b12d69-b463-4880-96b8-c99d158488e3 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'fault' on Instance uuid fa4062d3-a547-4be9-b840-e5f9a4ca1205 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:58:41.857817 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ff6d089f-c2d2-4678-8240-0a947a70cfd1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:41.858426 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ff6d089f-c2d2-4678-8240-0a947a70cfd1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:41.858714 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b6b12d69-b463-4880-96b8-c99d158488e3 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:41.867515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b6b12d69-b463-4880-96b8-c99d158488e3 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1309 microversion: 2.1 time: 0.104501 May 13 14:58:41.868175 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ff6d089f-c2d2-4678-8240-0a947a70cfd1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:41.868355 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 265/557] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:41 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:41.868701 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ff6d089f-c2d2-4678-8240-0a947a70cfd1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:41.869581 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ff6d089f-c2d2-4678-8240-0a947a70cfd1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:41.870017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ff6d089f-c2d2-4678-8240-0a947a70cfd1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:42.016513 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ff6d089f-c2d2-4678-8240-0a947a70cfd1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:42.030672 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ff6d089f-c2d2-4678-8240-0a947a70cfd1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:42.033069 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ff6d089f-c2d2-4678-8240-0a947a70cfd1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:42.034884 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ff6d089f-c2d2-4678-8240-0a947a70cfd1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.181235 May 13 14:58:42.035820 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 293/558] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:41 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:42.885929 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3a2be074-a690-4274-91fa-78c2e8ba04d7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:42.886566 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-3a2be074-a690-4274-91fa-78c2e8ba04d7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:42.893400 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a2be074-a690-4274-91fa-78c2e8ba04d7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:42.893840 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a2be074-a690-4274-91fa-78c2e8ba04d7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:42.894596 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a2be074-a690-4274-91fa-78c2e8ba04d7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:42.895023 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a2be074-a690-4274-91fa-78c2e8ba04d7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:42.931259 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a2be074-a690-4274-91fa-78c2e8ba04d7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:42.931673 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a2be074-a690-4274-91fa-78c2e8ba04d7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:42.932152 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-3a2be074-a690-4274-91fa-78c2e8ba04d7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'fault' on Instance uuid fa4062d3-a547-4be9-b840-e5f9a4ca1205 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:58:42.973191 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3a2be074-a690-4274-91fa-78c2e8ba04d7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:42.981870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-3a2be074-a690-4274-91fa-78c2e8ba04d7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1309 microversion: 2.1 time: 0.100175 May 13 14:58:42.982428 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 266/559] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:42 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:43.059285 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-0d250273-0f39-416a-9b16-1aeed4fe699b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:43.060328 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-0d250273-0f39-416a-9b16-1aeed4fe699b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:43.070974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0d250273-0f39-416a-9b16-1aeed4fe699b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:43.071425 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0d250273-0f39-416a-9b16-1aeed4fe699b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:43.072251 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0d250273-0f39-416a-9b16-1aeed4fe699b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:43.072685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0d250273-0f39-416a-9b16-1aeed4fe699b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:43.209341 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-0d250273-0f39-416a-9b16-1aeed4fe699b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:43.218573 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-0d250273-0f39-416a-9b16-1aeed4fe699b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:43.220077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-0d250273-0f39-416a-9b16-1aeed4fe699b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:43.221233 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-0d250273-0f39-416a-9b16-1aeed4fe699b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.169067 May 13 14:58:43.221785 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 294/560] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:43 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:44.000163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8f369362-1369-4b55-9c86-d7a61cfc928d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:44.000873 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8f369362-1369-4b55-9c86-d7a61cfc928d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:44.008372 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f369362-1369-4b55-9c86-d7a61cfc928d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:44.008871 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f369362-1369-4b55-9c86-d7a61cfc928d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:44.009780 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f369362-1369-4b55-9c86-d7a61cfc928d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:44.010247 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f369362-1369-4b55-9c86-d7a61cfc928d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:44.042919 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f369362-1369-4b55-9c86-d7a61cfc928d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:44.043389 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f369362-1369-4b55-9c86-d7a61cfc928d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:44.043809 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-8f369362-1369-4b55-9c86-d7a61cfc928d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'fault' on Instance uuid fa4062d3-a547-4be9-b840-e5f9a4ca1205 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:58:44.087501 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8f369362-1369-4b55-9c86-d7a61cfc928d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:44.095000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8f369362-1369-4b55-9c86-d7a61cfc928d tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1309 microversion: 2.1 time: 0.099212 May 13 14:58:44.095538 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 267/561] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:43 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:44.243492 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-bfa7bbbc-bfa1-4c7f-8dbe-c679406a892e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:44.244675 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-bfa7bbbc-bfa1-4c7f-8dbe-c679406a892e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:44.254881 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bfa7bbbc-bfa1-4c7f-8dbe-c679406a892e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:44.255487 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bfa7bbbc-bfa1-4c7f-8dbe-c679406a892e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:44.256716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bfa7bbbc-bfa1-4c7f-8dbe-c679406a892e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:44.257389 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bfa7bbbc-bfa1-4c7f-8dbe-c679406a892e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:44.391491 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-bfa7bbbc-bfa1-4c7f-8dbe-c679406a892e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:44.400221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-bfa7bbbc-bfa1-4c7f-8dbe-c679406a892e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:44.401706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-bfa7bbbc-bfa1-4c7f-8dbe-c679406a892e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:44.402879 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-bfa7bbbc-bfa1-4c7f-8dbe-c679406a892e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.165421 May 13 14:58:44.403459 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 295/562] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:44 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:45.116830 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-bae1d7c3-7c29-425d-b0fe-1dcfab3c14fb tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:45.117873 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-bae1d7c3-7c29-425d-b0fe-1dcfab3c14fb tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:45.128653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bae1d7c3-7c29-425d-b0fe-1dcfab3c14fb tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:45.129387 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bae1d7c3-7c29-425d-b0fe-1dcfab3c14fb tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:45.130635 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bae1d7c3-7c29-425d-b0fe-1dcfab3c14fb tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:45.131344 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bae1d7c3-7c29-425d-b0fe-1dcfab3c14fb tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:45.164348 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bae1d7c3-7c29-425d-b0fe-1dcfab3c14fb tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:45.164785 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bae1d7c3-7c29-425d-b0fe-1dcfab3c14fb tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:45.165339 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-bae1d7c3-7c29-425d-b0fe-1dcfab3c14fb tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'fault' on Instance uuid fa4062d3-a547-4be9-b840-e5f9a4ca1205 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:58:45.216895 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-bae1d7c3-7c29-425d-b0fe-1dcfab3c14fb tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:45.224558 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-bae1d7c3-7c29-425d-b0fe-1dcfab3c14fb tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 200 len: 1309 microversion: 2.1 time: 0.114459 May 13 14:58:45.225118 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 268/563] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:45 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 1309 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:45.425950 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-5513acfc-bdf3-4182-a60e-72262afbeead tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:45.426817 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-5513acfc-bdf3-4182-a60e-72262afbeead tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:45.435228 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5513acfc-bdf3-4182-a60e-72262afbeead tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:45.435676 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5513acfc-bdf3-4182-a60e-72262afbeead tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:45.436479 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5513acfc-bdf3-4182-a60e-72262afbeead tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:45.436912 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5513acfc-bdf3-4182-a60e-72262afbeead tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:45.575350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-5513acfc-bdf3-4182-a60e-72262afbeead tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:45.587530 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-5513acfc-bdf3-4182-a60e-72262afbeead tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:45.589040 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-5513acfc-bdf3-4182-a60e-72262afbeead tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:45.590199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-5513acfc-bdf3-4182-a60e-72262afbeead tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.170984 May 13 14:58:45.590784 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 296/564] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:45 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:46.243010 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5e0702b6-d449-419e-b1e0-a49e723f54e7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:46.243593 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5e0702b6-d449-419e-b1e0-a49e723f54e7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: fa4062d3-a547-4be9-b840-e5f9a4ca1205] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:46.250940 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5e0702b6-d449-419e-b1e0-a49e723f54e7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:46.251389 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5e0702b6-d449-419e-b1e0-a49e723f54e7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:46.252206 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5e0702b6-d449-419e-b1e0-a49e723f54e7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:46.252639 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5e0702b6-d449-419e-b1e0-a49e723f54e7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:46.266609 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-5e0702b6-d449-419e-b1e0-a49e723f54e7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] HTTP exception thrown: Instance fa4062d3-a547-4be9-b840-e5f9a4ca1205 could not be found. May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5e0702b6-d449-419e-b1e0-a49e723f54e7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Request method failure captured: May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 HTTP/1.1 May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnG_IuZXpKXhwp1CEGY7AAIqjEOgNH2wAA69z6YCwaBmIvry8g34LdHMlriwjfsQ1JraPdrwzHBIh-ElnYQShuzQd8xlp2dVkO0rlTloVV4cz92R1T8HvYtQtn_Tqj4rRxH608ampJAuEmlEW_SlCVHbZgudCiKGqBUQXaTO8YMRcpk May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 9cf795995a52452f93da8f04eb878e7b May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-VolumesSnapshotTestJSON-313197531 May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 14:58:46.268326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 14:58:46.269841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9cf795995a52452f93da8f04eb878e7b", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9cf795995a52452f93da8f04eb878e7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9cf795995a52452f93da8f04eb878e7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9cf795995a52452f93da8f04eb878e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:58:46.269841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-VolumesSnapshotTestJSON-313197531 May 13 14:58:46.269841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 9cf795995a52452f93da8f04eb878e7b May 13 14:58:46.269841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-313197531 May 13 14:58:46.269841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-VolumesSnapshotTestJSON-313197531-project May 13 14:58:46.269841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 14:58:46.269841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 14:58:46.269841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: 08b114f5b57146d8b4324231982ce7d4 May 13 14:58:46.269841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-VolumesSnapshotTestJSON-313197531-project May 13 14:58:46.269841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 14:58:46.269841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance fa4062d3-a547-4be9-b840-e5f9a4ca1205 could not be found. May 13 14:58:46.269841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': 'fa4062d3-a547-4be9-b840-e5f9a4ca1205'} May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa4062d3-a547-4be9-b840-e5f9a4ca1205 could not be found. May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:58:46.270784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa4062d3-a547-4be9-b840-e5f9a4ca1205 could not be found. May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa4062d3-a547-4be9-b840-e5f9a4ca1205 could not be found. May 13 14:58:46.272287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 14:58:46.273721 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5e0702b6-d449-419e-b1e0-a49e723f54e7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Returning 404 to user: Instance fa4062d3-a547-4be9-b840-e5f9a4ca1205 could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:58:46.273721 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5e0702b6-d449-419e-b1e0-a49e723f54e7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205" status: 404 len: 111 microversion: 2.1 time: 0.031069 May 13 14:58:46.273721 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 269/565] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:46 2022] GET /compute/v2.1/servers/fa4062d3-a547-4be9-b840-e5f9a4ca1205 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:58:46.609431 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-71c43643-d1f4-4429-b3e3-4e1a2a6cfd1b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:46.610003 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-71c43643-d1f4-4429-b3e3-4e1a2a6cfd1b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:46.616589 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-71c43643-d1f4-4429-b3e3-4e1a2a6cfd1b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:46.617031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-71c43643-d1f4-4429-b3e3-4e1a2a6cfd1b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:46.617802 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-71c43643-d1f4-4429-b3e3-4e1a2a6cfd1b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:46.618241 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-71c43643-d1f4-4429-b3e3-4e1a2a6cfd1b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:46.758108 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-71c43643-d1f4-4429-b3e3-4e1a2a6cfd1b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:46.767324 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-71c43643-d1f4-4429-b3e3-4e1a2a6cfd1b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:46.768782 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-71c43643-d1f4-4429-b3e3-4e1a2a6cfd1b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:46.769988 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-71c43643-d1f4-4429-b3e3-4e1a2a6cfd1b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.164869 May 13 14:58:46.770551 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 297/566] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:46 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:47.789060 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-49509b6b-ec0e-42f7-9c09-8028491a70dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:47.789632 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-49509b6b-ec0e-42f7-9c09-8028491a70dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:47.797204 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-49509b6b-ec0e-42f7-9c09-8028491a70dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:47.797654 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-49509b6b-ec0e-42f7-9c09-8028491a70dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:47.798442 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-49509b6b-ec0e-42f7-9c09-8028491a70dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:47.798905 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-49509b6b-ec0e-42f7-9c09-8028491a70dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:47.958424 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-49509b6b-ec0e-42f7-9c09-8028491a70dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:47.967704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-49509b6b-ec0e-42f7-9c09-8028491a70dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:47.969640 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-49509b6b-ec0e-42f7-9c09-8028491a70dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:47.970883 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-49509b6b-ec0e-42f7-9c09-8028491a70dd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.185920 May 13 14:58:47.971620 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 270/567] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:47 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:48.997178 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3e72f364-b621-4fa2-bc73-026d27ff3c51 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:48.998120 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3e72f364-b621-4fa2-bc73-026d27ff3c51 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:49.008976 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3e72f364-b621-4fa2-bc73-026d27ff3c51 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:49.010045 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3e72f364-b621-4fa2-bc73-026d27ff3c51 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:49.010828 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3e72f364-b621-4fa2-bc73-026d27ff3c51 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:49.011268 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3e72f364-b621-4fa2-bc73-026d27ff3c51 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:49.158894 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3e72f364-b621-4fa2-bc73-026d27ff3c51 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:49.168013 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3e72f364-b621-4fa2-bc73-026d27ff3c51 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:49.169445 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3e72f364-b621-4fa2-bc73-026d27ff3c51 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:49.170623 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3e72f364-b621-4fa2-bc73-026d27ff3c51 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.180519 May 13 14:58:49.171187 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 298/568] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:48 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:50.193432 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9b3e9c54-3bcc-4f53-9b04-1709754d52bd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:50.194458 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-9b3e9c54-3bcc-4f53-9b04-1709754d52bd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:50.203261 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9b3e9c54-3bcc-4f53-9b04-1709754d52bd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:50.203713 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9b3e9c54-3bcc-4f53-9b04-1709754d52bd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:50.204515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9b3e9c54-3bcc-4f53-9b04-1709754d52bd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:50.204955 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9b3e9c54-3bcc-4f53-9b04-1709754d52bd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:50.345484 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9b3e9c54-3bcc-4f53-9b04-1709754d52bd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:50.354227 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9b3e9c54-3bcc-4f53-9b04-1709754d52bd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:50.356719 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9b3e9c54-3bcc-4f53-9b04-1709754d52bd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:50.357859 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9b3e9c54-3bcc-4f53-9b04-1709754d52bd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.170702 May 13 14:58:50.358448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 271/569] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:50 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:51.385102 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-87373987-1f60-4881-affd-670b6f1beb6a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:51.386107 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-87373987-1f60-4881-affd-670b6f1beb6a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:51.397072 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-87373987-1f60-4881-affd-670b6f1beb6a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:51.397805 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-87373987-1f60-4881-affd-670b6f1beb6a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:51.399140 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-87373987-1f60-4881-affd-670b6f1beb6a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:51.399862 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-87373987-1f60-4881-affd-670b6f1beb6a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:51.538255 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-87373987-1f60-4881-affd-670b6f1beb6a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:51.547896 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-87373987-1f60-4881-affd-670b6f1beb6a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:51.549414 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-87373987-1f60-4881-affd-670b6f1beb6a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:51.550597 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-87373987-1f60-4881-affd-670b6f1beb6a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.170828 May 13 14:58:51.551177 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 299/570] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:51 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:52.570787 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3e4b439c-7f25-4210-9bd1-360c82d7eaaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:52.571263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-3e4b439c-7f25-4210-9bd1-360c82d7eaaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:52.578849 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3e4b439c-7f25-4210-9bd1-360c82d7eaaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:52.579297 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3e4b439c-7f25-4210-9bd1-360c82d7eaaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:52.580107 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3e4b439c-7f25-4210-9bd1-360c82d7eaaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:52.580538 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3e4b439c-7f25-4210-9bd1-360c82d7eaaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:52.728042 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3e4b439c-7f25-4210-9bd1-360c82d7eaaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:52.737631 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3e4b439c-7f25-4210-9bd1-360c82d7eaaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:52.739196 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3e4b439c-7f25-4210-9bd1-360c82d7eaaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:52.740427 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-3e4b439c-7f25-4210-9bd1-360c82d7eaaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.174568 May 13 14:58:52.740988 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 272/571] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:52 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:53.766205 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-dcdc2a47-de34-4851-b95e-9761f20053e0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:53.767151 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-dcdc2a47-de34-4851-b95e-9761f20053e0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:53.777472 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dcdc2a47-de34-4851-b95e-9761f20053e0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:53.777849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dcdc2a47-de34-4851-b95e-9761f20053e0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:53.778626 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dcdc2a47-de34-4851-b95e-9761f20053e0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:53.779052 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dcdc2a47-de34-4851-b95e-9761f20053e0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:53.927148 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-dcdc2a47-de34-4851-b95e-9761f20053e0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:53.936326 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-dcdc2a47-de34-4851-b95e-9761f20053e0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:53.937820 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-dcdc2a47-de34-4851-b95e-9761f20053e0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:53.938977 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-dcdc2a47-de34-4851-b95e-9761f20053e0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.178810 May 13 14:58:53.939531 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 300/572] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:53 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:54.962795 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b740c2c4-6b9e-4f94-8c3f-91a7170207b7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:54.964038 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b740c2c4-6b9e-4f94-8c3f-91a7170207b7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:54.978138 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b740c2c4-6b9e-4f94-8c3f-91a7170207b7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:54.979166 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b740c2c4-6b9e-4f94-8c3f-91a7170207b7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:54.981258 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b740c2c4-6b9e-4f94-8c3f-91a7170207b7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:54.981820 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b740c2c4-6b9e-4f94-8c3f-91a7170207b7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:55.116587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b740c2c4-6b9e-4f94-8c3f-91a7170207b7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:55.125651 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b740c2c4-6b9e-4f94-8c3f-91a7170207b7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:55.127133 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b740c2c4-6b9e-4f94-8c3f-91a7170207b7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:55.128348 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b740c2c4-6b9e-4f94-8c3f-91a7170207b7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.173530 May 13 14:58:55.128917 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 273/573] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:54 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:56.146749 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ca6d057a-5134-4e40-9768-c3ffc2a348ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:56.147298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ca6d057a-5134-4e40-9768-c3ffc2a348ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:56.154325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ca6d057a-5134-4e40-9768-c3ffc2a348ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:56.154766 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ca6d057a-5134-4e40-9768-c3ffc2a348ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:56.155534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ca6d057a-5134-4e40-9768-c3ffc2a348ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:56.155995 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ca6d057a-5134-4e40-9768-c3ffc2a348ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:56.297826 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ca6d057a-5134-4e40-9768-c3ffc2a348ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:56.307279 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ca6d057a-5134-4e40-9768-c3ffc2a348ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:56.308986 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ca6d057a-5134-4e40-9768-c3ffc2a348ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:56.310312 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ca6d057a-5134-4e40-9768-c3ffc2a348ed tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.167470 May 13 14:58:56.310883 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 301/574] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:56 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:57.333019 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c999c365-2d63-447c-be8f-740c21c5d7b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:57.333917 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c999c365-2d63-447c-be8f-740c21c5d7b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:57.342909 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c999c365-2d63-447c-be8f-740c21c5d7b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:57.343338 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c999c365-2d63-447c-be8f-740c21c5d7b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:57.344136 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c999c365-2d63-447c-be8f-740c21c5d7b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:57.344614 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c999c365-2d63-447c-be8f-740c21c5d7b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:57.496081 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c999c365-2d63-447c-be8f-740c21c5d7b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:57.504935 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c999c365-2d63-447c-be8f-740c21c5d7b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:57.506394 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c999c365-2d63-447c-be8f-740c21c5d7b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:57.507591 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c999c365-2d63-447c-be8f-740c21c5d7b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.180977 May 13 14:58:57.508321 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 274/575] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:57 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:58.284457 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c5cca659-25a9-468a-a38b-a2c984d514fc tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1751923679", "imageRef": "eac0bc7b-d963-4624-aba3-a81fd1bf324c", "flavorRef": "452", "networks": [{"uuid": "c7b57fa3-00c8-4e2a-afac-0dc64b67c56e"}]}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:58:58.335241 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.network.neutron [None req-c5cca659-25a9-468a-a38b-a2c984d514fc tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] validate_networks() for [('c7b57fa3-00c8-4e2a-afac-0dc64b67c56e', None, None, None, None, None)] {{(pid=117295) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:58:58.526356 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1bd1724a-a693-4ed2-ac4b-b16391c61c5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:58.527028 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1bd1724a-a693-4ed2-ac4b-b16391c61c5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:58.533531 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1bd1724a-a693-4ed2-ac4b-b16391c61c5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:58.533978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1bd1724a-a693-4ed2-ac4b-b16391c61c5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:58.534840 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1bd1724a-a693-4ed2-ac4b-b16391c61c5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:58.535274 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1bd1724a-a693-4ed2-ac4b-b16391c61c5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:58.742180 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1bd1724a-a693-4ed2-ac4b-b16391c61c5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:58.750797 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1bd1724a-a693-4ed2-ac4b-b16391c61c5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:58.752655 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1bd1724a-a693-4ed2-ac4b-b16391c61c5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:58.753820 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1bd1724a-a693-4ed2-ac4b-b16391c61c5e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.231460 May 13 14:58:58.754434 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 275/576] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:58 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:58.759551 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-c5cca659-25a9-468a-a38b-a2c984d514fc tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Flavor limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:58:58.760429 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-c5cca659-25a9-468a-a38b-a2c984d514fc tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Image limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:58:58.760664 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-c5cca659-25a9-468a-a38b-a2c984d514fc tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Flavor pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:58:58.760873 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-c5cca659-25a9-468a-a38b-a2c984d514fc tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Image pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:58:58.761884 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-c5cca659-25a9-468a-a38b-a2c984d514fc tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:58:58.771011 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c5cca659-25a9-468a-a38b-a2c984d514fc tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:58.771459 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c5cca659-25a9-468a-a38b-a2c984d514fc tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:58.772332 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c5cca659-25a9-468a-a38b-a2c984d514fc tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:58.772762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c5cca659-25a9-468a-a38b-a2c984d514fc tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:58.789822 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-c5cca659-25a9-468a-a38b-a2c984d514fc tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Getting quotas for project 9cf795995a52452f93da8f04eb878e7b. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:58:58.793777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-c5cca659-25a9-468a-a38b-a2c984d514fc tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Getting quotas for user 08b114f5b57146d8b4324231982ce7d4 and project 9cf795995a52452f93da8f04eb878e7b. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:58:58.805019 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c5cca659-25a9-468a-a38b-a2c984d514fc tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Going to run 1 instances... {{(pid=117295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:58:58.807292 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c5cca659-25a9-468a-a38b-a2c984d514fc tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac0bc7b-d963-4624-aba3-a81fd1bf324c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:58:58.863134 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c5cca659-25a9-468a-a38b-a2c984d514fc tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582510 May 13 14:58:58.863778 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 302/577] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 14:58:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:58:58.873809 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-d73ee975-5e1b-42f5-9e0b-4f5d91c4f576 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:58.874411 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-d73ee975-5e1b-42f5-9e0b-4f5d91c4f576 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:58.928472 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-d73ee975-5e1b-42f5-9e0b-4f5d91c4f576 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:58.935183 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-d73ee975-5e1b-42f5-9e0b-4f5d91c4f576 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1219 microversion: 2.1 time: 0.065415 May 13 14:58:58.935726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 276/578] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:58 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:58:59.479081 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-c4f379dc-e30d-4709-9c36-86301cda965c req-68f858a9-fdde-4bf9-905a-0a8d38cacfe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96db69fe-6594-486c-96b3-545e6dbfa29b", "name": "network-vif-plugged", "status": "completed", "tag": "4fd5686b-8efb-4342-9683-06dad26579b5"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:58:59.491766 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-c4f379dc-e30d-4709-9c36-86301cda965c req-68f858a9-fdde-4bf9-905a-0a8d38cacfe5 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:59.492234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-c4f379dc-e30d-4709-9c36-86301cda965c req-68f858a9-fdde-4bf9-905a-0a8d38cacfe5 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:59.506402 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-c4f379dc-e30d-4709-9c36-86301cda965c req-68f858a9-fdde-4bf9-905a-0a8d38cacfe5 service nova] Creating event network-vif-plugged:4fd5686b-8efb-4342-9683-06dad26579b5 for instance 96db69fe-6594-486c-96b3-545e6dbfa29b on hv-cinder-83090 May 13 14:58:59.512861 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-c4f379dc-e30d-4709-9c36-86301cda965c req-68f858a9-fdde-4bf9-905a-0a8d38cacfe5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043457 May 13 14:58:59.513729 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 303/579] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:58:59.772401 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b4e42a25-a16e-49e8-bc33-0c12e4cf34a4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:59.773001 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b4e42a25-a16e-49e8-bc33-0c12e4cf34a4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:59.782131 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b4e42a25-a16e-49e8-bc33-0c12e4cf34a4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:59.782580 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b4e42a25-a16e-49e8-bc33-0c12e4cf34a4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:59.783351 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b4e42a25-a16e-49e8-bc33-0c12e4cf34a4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:59.783785 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b4e42a25-a16e-49e8-bc33-0c12e4cf34a4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:59.918056 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b4e42a25-a16e-49e8-bc33-0c12e4cf34a4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:59.926951 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b4e42a25-a16e-49e8-bc33-0c12e4cf34a4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:59.928450 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b4e42a25-a16e-49e8-bc33-0c12e4cf34a4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:58:59.929626 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b4e42a25-a16e-49e8-bc33-0c12e4cf34a4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.161078 May 13 14:58:59.930195 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 277/580] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:58:59 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:58:59.953535 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-caa152cb-0723-40ba-a008-61c307d95a98 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:58:59.954239 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-caa152cb-0723-40ba-a008-61c307d95a98 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:58:59.960574 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-caa152cb-0723-40ba-a008-61c307d95a98 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:59.961029 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-caa152cb-0723-40ba-a008-61c307d95a98 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:58:59.961845 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-caa152cb-0723-40ba-a008-61c307d95a98 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:58:59.962273 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-caa152cb-0723-40ba-a008-61c307d95a98 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:00.029709 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-caa152cb-0723-40ba-a008-61c307d95a98 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:00.037618 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-caa152cb-0723-40ba-a008-61c307d95a98 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1271 microversion: 2.1 time: 0.089640 May 13 14:59:00.038150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 304/581] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:58:59 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:00.949944 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-041be671-165c-4512-bf80-91e56c8cff43 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:00.950517 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-041be671-165c-4512-bf80-91e56c8cff43 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:00.962734 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-041be671-165c-4512-bf80-91e56c8cff43 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:00.963193 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-041be671-165c-4512-bf80-91e56c8cff43 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:00.964053 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-041be671-165c-4512-bf80-91e56c8cff43 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:00.964990 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-041be671-165c-4512-bf80-91e56c8cff43 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:01.054951 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-7dcce63f-f8de-4bab-b227-acb11817eee7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:01.055543 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-7dcce63f-f8de-4bab-b227-acb11817eee7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:01.062803 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7dcce63f-f8de-4bab-b227-acb11817eee7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:01.063255 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7dcce63f-f8de-4bab-b227-acb11817eee7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:01.064097 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7dcce63f-f8de-4bab-b227-acb11817eee7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:01.064710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7dcce63f-f8de-4bab-b227-acb11817eee7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:01.468340 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-041be671-165c-4512-bf80-91e56c8cff43 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:01.477625 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-041be671-165c-4512-bf80-91e56c8cff43 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:01.479038 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-041be671-165c-4512-bf80-91e56c8cff43 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:01.480815 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-041be671-165c-4512-bf80-91e56c8cff43 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.534437 May 13 14:59:01.481868 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 278/582] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:59:00 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:59:01.487540 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-7dcce63f-f8de-4bab-b227-acb11817eee7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:01.495166 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-7dcce63f-f8de-4bab-b227-acb11817eee7 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1319 microversion: 2.1 time: 0.444266 May 13 14:59:01.496080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 305/583] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:01 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:59:02.429124 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-511d5eea-0c46-4987-9ac5-7b1b49713f84 req-f41c04d2-1e18-466b-819f-e61868fdd632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e0a674-f5d3-4352-9e65-b7b341d13011", "tag": "f57376c8-5dfd-4194-81c7-881b55e976fe"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:59:02.437935 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-511d5eea-0c46-4987-9ac5-7b1b49713f84 req-f41c04d2-1e18-466b-819f-e61868fdd632 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:02.438366 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-511d5eea-0c46-4987-9ac5-7b1b49713f84 req-f41c04d2-1e18-466b-819f-e61868fdd632 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:02.449951 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-511d5eea-0c46-4987-9ac5-7b1b49713f84 req-f41c04d2-1e18-466b-819f-e61868fdd632 service nova] Creating event network-changed:f57376c8-5dfd-4194-81c7-881b55e976fe for instance 03e0a674-f5d3-4352-9e65-b7b341d13011 on hv-cinder-83090 May 13 14:59:02.455017 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-511d5eea-0c46-4987-9ac5-7b1b49713f84 req-f41c04d2-1e18-466b-819f-e61868fdd632 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029411 May 13 14:59:02.455617 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 279/584] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:59:02.503004 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-bf10888e-a4bc-4e1e-85a6-74c31eb78c88 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:02.503620 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-bf10888e-a4bc-4e1e-85a6-74c31eb78c88 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:02.514192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f53725b1-86db-4cec-b59d-7a0dfe3edea5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:02.514761 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f53725b1-86db-4cec-b59d-7a0dfe3edea5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:02.515438 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf10888e-a4bc-4e1e-85a6-74c31eb78c88 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:02.515895 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf10888e-a4bc-4e1e-85a6-74c31eb78c88 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:02.516679 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf10888e-a4bc-4e1e-85a6-74c31eb78c88 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:02.517108 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf10888e-a4bc-4e1e-85a6-74c31eb78c88 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:02.521124 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f53725b1-86db-4cec-b59d-7a0dfe3edea5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:02.521572 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f53725b1-86db-4cec-b59d-7a0dfe3edea5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:02.522365 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f53725b1-86db-4cec-b59d-7a0dfe3edea5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:02.522803 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f53725b1-86db-4cec-b59d-7a0dfe3edea5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:02.719235 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-bf10888e-a4bc-4e1e-85a6-74c31eb78c88 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:02.722367 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f53725b1-86db-4cec-b59d-7a0dfe3edea5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:02.729020 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-bf10888e-a4bc-4e1e-85a6-74c31eb78c88 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:02.730438 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f53725b1-86db-4cec-b59d-7a0dfe3edea5 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1319 microversion: 2.1 time: 0.221169 May 13 14:59:02.730670 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-bf10888e-a4bc-4e1e-85a6-74c31eb78c88 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:02.731459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 280/585] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:02 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:02.732260 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-bf10888e-a4bc-4e1e-85a6-74c31eb78c88 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.235648 May 13 14:59:02.732825 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 306/586] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:59:02 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:59:03.748670 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1f0bb8b6-13ee-4311-9266-753179b3a520 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:03.749376 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1f0bb8b6-13ee-4311-9266-753179b3a520 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:03.750432 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9cf72634-9211-4795-aba8-9b56b1ce19e1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:03.751036 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9cf72634-9211-4795-aba8-9b56b1ce19e1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:03.756101 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f0bb8b6-13ee-4311-9266-753179b3a520 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:03.756557 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f0bb8b6-13ee-4311-9266-753179b3a520 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:03.757718 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f0bb8b6-13ee-4311-9266-753179b3a520 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:03.757871 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9cf72634-9211-4795-aba8-9b56b1ce19e1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:03.758123 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f0bb8b6-13ee-4311-9266-753179b3a520 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:03.758232 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9cf72634-9211-4795-aba8-9b56b1ce19e1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:03.759000 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9cf72634-9211-4795-aba8-9b56b1ce19e1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:03.759446 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9cf72634-9211-4795-aba8-9b56b1ce19e1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:03.991689 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1f0bb8b6-13ee-4311-9266-753179b3a520 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:03.996782 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9cf72634-9211-4795-aba8-9b56b1ce19e1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:04.000321 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1f0bb8b6-13ee-4311-9266-753179b3a520 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1319 microversion: 2.1 time: 0.255761 May 13 14:59:04.001176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 281/587] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:03 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:04.007245 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9cf72634-9211-4795-aba8-9b56b1ce19e1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:04.008739 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9cf72634-9211-4795-aba8-9b56b1ce19e1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:04.018189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9cf72634-9211-4795-aba8-9b56b1ce19e1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1808 microversion: 2.20 time: 0.263392 May 13 14:59:04.018882 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 307/588] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:59:03 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:59:05.021287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-2db99c3a-7309-446b-8306-1713f55a0425 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:05.022173 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-2db99c3a-7309-446b-8306-1713f55a0425 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:05.031164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2db99c3a-7309-446b-8306-1713f55a0425 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:05.031609 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2db99c3a-7309-446b-8306-1713f55a0425 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:05.032388 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2db99c3a-7309-446b-8306-1713f55a0425 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:05.032817 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2db99c3a-7309-446b-8306-1713f55a0425 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:05.037127 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-493e34ea-da38-4eba-af1d-abbd870b72b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:05.037742 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-493e34ea-da38-4eba-af1d-abbd870b72b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:05.044159 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-493e34ea-da38-4eba-af1d-abbd870b72b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:05.044607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-493e34ea-da38-4eba-af1d-abbd870b72b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:05.045378 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-493e34ea-da38-4eba-af1d-abbd870b72b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:05.045812 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-493e34ea-da38-4eba-af1d-abbd870b72b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:05.227428 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-2db99c3a-7309-446b-8306-1713f55a0425 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:05.237595 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-2db99c3a-7309-446b-8306-1713f55a0425 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1319 microversion: 2.1 time: 0.222406 May 13 14:59:05.237997 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 282/589] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:05 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:05.239979 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-493e34ea-da38-4eba-af1d-abbd870b72b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:05.248714 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-493e34ea-da38-4eba-af1d-abbd870b72b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:05.250206 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-493e34ea-da38-4eba-af1d-abbd870b72b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:05.251359 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-493e34ea-da38-4eba-af1d-abbd870b72b4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1795 microversion: 2.20 time: 0.218155 May 13 14:59:05.251917 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 308/590] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 14:59:05 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1795 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:59:06.258742 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c478baac-0bbd-4743-8c1b-689c1e536617 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:06.259770 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c478baac-0bbd-4743-8c1b-689c1e536617 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:06.267905 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c478baac-0bbd-4743-8c1b-689c1e536617 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:06.268381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c478baac-0bbd-4743-8c1b-689c1e536617 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:06.269153 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c478baac-0bbd-4743-8c1b-689c1e536617 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:06.269565 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c478baac-0bbd-4743-8c1b-689c1e536617 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:06.405993 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c478baac-0bbd-4743-8c1b-689c1e536617 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:06.413748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c478baac-0bbd-4743-8c1b-689c1e536617 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1319 microversion: 2.1 time: 0.161570 May 13 14:59:06.414336 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 283/591] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:06 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:07.431480 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3ddeaaa7-0d2b-46be-bf8c-6bb0f6694324 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:07.432105 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3ddeaaa7-0d2b-46be-bf8c-6bb0f6694324 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:07.439631 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3ddeaaa7-0d2b-46be-bf8c-6bb0f6694324 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:07.440110 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3ddeaaa7-0d2b-46be-bf8c-6bb0f6694324 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:07.440897 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3ddeaaa7-0d2b-46be-bf8c-6bb0f6694324 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:07.441336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3ddeaaa7-0d2b-46be-bf8c-6bb0f6694324 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:07.580965 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3ddeaaa7-0d2b-46be-bf8c-6bb0f6694324 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:07.590221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3ddeaaa7-0d2b-46be-bf8c-6bb0f6694324 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1319 microversion: 2.1 time: 0.161803 May 13 14:59:07.591002 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 309/592] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:07 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:08.611555 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c4705e21-8d6d-413e-a01d-0f27ed97ac00 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:08.612514 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c4705e21-8d6d-413e-a01d-0f27ed97ac00 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:08.623059 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c4705e21-8d6d-413e-a01d-0f27ed97ac00 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:08.623506 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c4705e21-8d6d-413e-a01d-0f27ed97ac00 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:08.624329 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c4705e21-8d6d-413e-a01d-0f27ed97ac00 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:08.624762 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c4705e21-8d6d-413e-a01d-0f27ed97ac00 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:08.762218 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c4705e21-8d6d-413e-a01d-0f27ed97ac00 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:08.769961 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c4705e21-8d6d-413e-a01d-0f27ed97ac00 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1319 microversion: 2.1 time: 0.165732 May 13 14:59:08.770521 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 284/593] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:08 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:09.791022 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-57532631-b92b-4a59-aee5-e91eea20f8fd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:09.792120 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-57532631-b92b-4a59-aee5-e91eea20f8fd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:09.799741 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-57532631-b92b-4a59-aee5-e91eea20f8fd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:09.800235 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-57532631-b92b-4a59-aee5-e91eea20f8fd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:09.801017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-57532631-b92b-4a59-aee5-e91eea20f8fd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:09.801452 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-57532631-b92b-4a59-aee5-e91eea20f8fd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:09.948335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-57532631-b92b-4a59-aee5-e91eea20f8fd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:09.956240 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-57532631-b92b-4a59-aee5-e91eea20f8fd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1319 microversion: 2.1 time: 0.171643 May 13 14:59:09.956796 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 310/594] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:09 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:10.984090 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e16af242-dc42-40e7-9097-c04b5cd7f486 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:10.984688 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-e16af242-dc42-40e7-9097-c04b5cd7f486 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:10.991128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e16af242-dc42-40e7-9097-c04b5cd7f486 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:10.991579 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e16af242-dc42-40e7-9097-c04b5cd7f486 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:10.992390 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e16af242-dc42-40e7-9097-c04b5cd7f486 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:10.992835 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e16af242-dc42-40e7-9097-c04b5cd7f486 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:11.138614 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e16af242-dc42-40e7-9097-c04b5cd7f486 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:11.146477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e16af242-dc42-40e7-9097-c04b5cd7f486 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1319 microversion: 2.1 time: 0.168977 May 13 14:59:11.147060 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 285/595] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:10 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:11.657146 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-d75d0ee3-4a9f-4c8f-9234-3a418724aa01 req-6874dff4-2046-41de-953a-683101a2130e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e0a674-f5d3-4352-9e65-b7b341d13011", "name": "network-vif-plugged", "status": "completed", "tag": "f57376c8-5dfd-4194-81c7-881b55e976fe"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:59:11.666436 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-d75d0ee3-4a9f-4c8f-9234-3a418724aa01 req-6874dff4-2046-41de-953a-683101a2130e service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:11.666915 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-d75d0ee3-4a9f-4c8f-9234-3a418724aa01 req-6874dff4-2046-41de-953a-683101a2130e service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:11.678281 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-d75d0ee3-4a9f-4c8f-9234-3a418724aa01 req-6874dff4-2046-41de-953a-683101a2130e service nova] Creating event network-vif-plugged:f57376c8-5dfd-4194-81c7-881b55e976fe for instance 03e0a674-f5d3-4352-9e65-b7b341d13011 on hv-cinder-83090 May 13 14:59:11.683473 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-d75d0ee3-4a9f-4c8f-9234-3a418724aa01 req-6874dff4-2046-41de-953a-683101a2130e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030615 May 13 14:59:11.684353 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 311/596] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:59:12.020318 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:59:12.020593 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Fri May 13 14:59:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:59:12.165528 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c6be6b9b-4a77-4f3c-aa01-48ff50797340 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:12.166083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c6be6b9b-4a77-4f3c-aa01-48ff50797340 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:12.173070 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c6be6b9b-4a77-4f3c-aa01-48ff50797340 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:12.173517 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c6be6b9b-4a77-4f3c-aa01-48ff50797340 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:12.174302 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c6be6b9b-4a77-4f3c-aa01-48ff50797340 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:12.174734 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c6be6b9b-4a77-4f3c-aa01-48ff50797340 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:12.325021 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c6be6b9b-4a77-4f3c-aa01-48ff50797340 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:12.337356 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c6be6b9b-4a77-4f3c-aa01-48ff50797340 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1319 microversion: 2.1 time: 0.175879 May 13 14:59:12.338193 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 286/597] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:12 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:13.368426 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-649265cd-b8af-4aca-8201-f5600099b59e tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:13.369367 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-649265cd-b8af-4aca-8201-f5600099b59e tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:13.377783 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-649265cd-b8af-4aca-8201-f5600099b59e tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:13.378229 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-649265cd-b8af-4aca-8201-f5600099b59e tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:13.378996 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-649265cd-b8af-4aca-8201-f5600099b59e tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:13.379435 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-649265cd-b8af-4aca-8201-f5600099b59e tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:13.527495 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-649265cd-b8af-4aca-8201-f5600099b59e tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:13.538640 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-649265cd-b8af-4aca-8201-f5600099b59e tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1319 microversion: 2.1 time: 0.177777 May 13 14:59:13.539443 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 312/598] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:13 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:14.561535 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e011c38c-44b9-4cd2-a4c3-e1a510e09fce tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:14.562131 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-e011c38c-44b9-4cd2-a4c3-e1a510e09fce tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:14.569104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e011c38c-44b9-4cd2-a4c3-e1a510e09fce tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:14.569563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e011c38c-44b9-4cd2-a4c3-e1a510e09fce tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:14.570335 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e011c38c-44b9-4cd2-a4c3-e1a510e09fce tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:14.570757 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e011c38c-44b9-4cd2-a4c3-e1a510e09fce tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:14.708706 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e011c38c-44b9-4cd2-a4c3-e1a510e09fce tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:14.719904 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e011c38c-44b9-4cd2-a4c3-e1a510e09fce tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1507 microversion: 2.1 time: 0.162360 May 13 14:59:14.720777 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 287/599] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:14 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:14.741848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d5155761-bba6-45ce-8233-ab95fb3aabc0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fd71728-e810-415c-8b1b-551d86439cbc", "device": "/dev/sdb"}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:59:14.742980 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d5155761-bba6-45ce-8233-ab95fb3aabc0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:14.749909 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d5155761-bba6-45ce-8233-ab95fb3aabc0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:14.750358 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d5155761-bba6-45ce-8233-ab95fb3aabc0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:14.751156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d5155761-bba6-45ce-8233-ab95fb3aabc0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:14.751592 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d5155761-bba6-45ce-8233-ab95fb3aabc0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:15.040162 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d5155761-bba6-45ce-8233-ab95fb3aabc0 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "POST /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302187 May 13 14:59:15.040789 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 313/600] 10.222.0.99 () {60 vars in 1322 bytes} [Fri May 13 14:59:14 2022] POST /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:59:32.382202 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5e4b78e2-6d1f-4e85-856d-dbee5af6db42 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcf58ff9-7710-46c9-98a2-59b1032eeb67"}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:59:32.383396 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5e4b78e2-6d1f-4e85-856d-dbee5af6db42 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:32.389953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5e4b78e2-6d1f-4e85-856d-dbee5af6db42 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:32.390415 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5e4b78e2-6d1f-4e85-856d-dbee5af6db42 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:32.391250 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5e4b78e2-6d1f-4e85-856d-dbee5af6db42 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:32.391735 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5e4b78e2-6d1f-4e85-856d-dbee5af6db42 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:33.926386 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5e4b78e2-6d1f-4e85-856d-dbee5af6db42 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "POST /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.670182 May 13 14:59:33.927327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 288/601] 10.222.0.99 () {60 vars in 1322 bytes} [Fri May 13 14:59:32 2022] POST /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/os-volume_attachments => generated 194 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:59:38.678294 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-2b1fc476-452b-4f03-885a-6875a1bf637f tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:38.678840 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-2b1fc476-452b-4f03-885a-6875a1bf637f tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:38.685899 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2b1fc476-452b-4f03-885a-6875a1bf637f tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:38.686346 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2b1fc476-452b-4f03-885a-6875a1bf637f tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:38.687113 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2b1fc476-452b-4f03-885a-6875a1bf637f tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:38.687546 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2b1fc476-452b-4f03-885a-6875a1bf637f tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:38.809558 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-2b1fc476-452b-4f03-885a-6875a1bf637f tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'services' on Instance uuid 03e0a674-f5d3-4352-9e65-b7b341d13011 {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:59:38.925862 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-2b1fc476-452b-4f03-885a-6875a1bf637f tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "DELETE /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011/os-volume_attachments/7fd71728-e810-415c-8b1b-551d86439cbc" status: 202 len: 0 microversion: 2.1 time: 0.251682 May 13 14:59:38.926452 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 314/602] 10.222.0.99 () {58 vars in 1415 bytes} [Fri May 13 14:59:38 2022] DELETE /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011/os-volume_attachments/7fd71728-e810-415c-8b1b-551d86439cbc => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:59:42.547750 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b2f9b0e3-5018-4e0b-b139-90668d874ace tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:59:42.548902 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b2f9b0e3-5018-4e0b-b139-90668d874ace tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:42.555386 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b2f9b0e3-5018-4e0b-b139-90668d874ace tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:42.555833 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b2f9b0e3-5018-4e0b-b139-90668d874ace tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:42.556652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b2f9b0e3-5018-4e0b-b139-90668d874ace tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:42.557086 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b2f9b0e3-5018-4e0b-b139-90668d874ace tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:42.580518 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-b2f9b0e3-5018-4e0b-b139-90668d874ace tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lazy-loading 'flavor' on Instance uuid 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:59:42.748615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b2f9b0e3-5018-4e0b-b139-90668d874ace tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "POST /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/action" status: 200 len: 32 microversion: 2.1 time: 0.206762 May 13 14:59:42.749227 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 289/603] 10.222.0.99 () {60 vars in 1277 bytes} [Fri May 13 14:59:42 2022] POST /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/action => generated 32 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 14:59:42.759981 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3168495c-18e6-457a-86ed-7548a5f4abe1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:42.760664 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3168495c-18e6-457a-86ed-7548a5f4abe1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:42.767701 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3168495c-18e6-457a-86ed-7548a5f4abe1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:42.768109 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3168495c-18e6-457a-86ed-7548a5f4abe1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:42.768890 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3168495c-18e6-457a-86ed-7548a5f4abe1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:42.769360 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3168495c-18e6-457a-86ed-7548a5f4abe1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:42.905046 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3168495c-18e6-457a-86ed-7548a5f4abe1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:42.913235 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3168495c-18e6-457a-86ed-7548a5f4abe1 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.158329 May 13 14:59:42.914001 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 315/604] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:42 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:43.218095 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f4693460-bc8b-4930-ae73-2c39c757e685 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:43.218679 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f4693460-bc8b-4930-ae73-2c39c757e685 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:43.225001 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f4693460-bc8b-4930-ae73-2c39c757e685 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:43.225463 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f4693460-bc8b-4930-ae73-2c39c757e685 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:43.226234 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f4693460-bc8b-4930-ae73-2c39c757e685 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:43.226668 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f4693460-bc8b-4930-ae73-2c39c757e685 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:43.252523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f4693460-bc8b-4930-ae73-2c39c757e685 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Going to try to terminate instance {{(pid=117296) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:59:43.332282 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f4693460-bc8b-4930-ae73-2c39c757e685 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "DELETE /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 204 len: 0 microversion: 2.1 time: 0.117996 May 13 14:59:43.333513 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 290/605] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 14:59:43 2022] DELETE /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:59:43.343951 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4d8d1d57-de45-4998-9b0d-1b9de117f5f2 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:43.344592 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4d8d1d57-de45-4998-9b0d-1b9de117f5f2 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:43.350727 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4d8d1d57-de45-4998-9b0d-1b9de117f5f2 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:43.351159 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4d8d1d57-de45-4998-9b0d-1b9de117f5f2 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:43.351958 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4d8d1d57-de45-4998-9b0d-1b9de117f5f2 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:43.352397 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4d8d1d57-de45-4998-9b0d-1b9de117f5f2 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:43.492800 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4d8d1d57-de45-4998-9b0d-1b9de117f5f2 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:43.500787 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4d8d1d57-de45-4998-9b0d-1b9de117f5f2 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1513 microversion: 2.1 time: 0.161472 May 13 14:59:43.501355 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 316/606] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:43 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:43.937189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-d275dd13-2e1a-4d24-a06b-12c5d1e75a87 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:43.938340 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-d275dd13-2e1a-4d24-a06b-12c5d1e75a87 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:43.949220 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d275dd13-2e1a-4d24-a06b-12c5d1e75a87 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:43.949972 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d275dd13-2e1a-4d24-a06b-12c5d1e75a87 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:43.951290 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d275dd13-2e1a-4d24-a06b-12c5d1e75a87 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:43.951732 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d275dd13-2e1a-4d24-a06b-12c5d1e75a87 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:44.085988 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-d275dd13-2e1a-4d24-a06b-12c5d1e75a87 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:44.095542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-d275dd13-2e1a-4d24-a06b-12c5d1e75a87 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.166605 May 13 14:59:44.096150 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 291/607] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:43 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:44.518166 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4add8fa6-1631-4b48-bd7d-7994a0a2cc30 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:44.518772 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4add8fa6-1631-4b48-bd7d-7994a0a2cc30 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:44.525820 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4add8fa6-1631-4b48-bd7d-7994a0a2cc30 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:44.526276 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4add8fa6-1631-4b48-bd7d-7994a0a2cc30 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:44.527075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4add8fa6-1631-4b48-bd7d-7994a0a2cc30 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:44.527509 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4add8fa6-1631-4b48-bd7d-7994a0a2cc30 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:44.680748 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4add8fa6-1631-4b48-bd7d-7994a0a2cc30 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:44.691863 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4add8fa6-1631-4b48-bd7d-7994a0a2cc30 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1513 microversion: 2.1 time: 0.177402 May 13 14:59:44.692658 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 317/608] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:44 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:45.120508 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f77e3a3c-f0b8-456e-8d44-11567c801034 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:45.121435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f77e3a3c-f0b8-456e-8d44-11567c801034 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:45.128828 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f77e3a3c-f0b8-456e-8d44-11567c801034 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:45.129282 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f77e3a3c-f0b8-456e-8d44-11567c801034 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:45.130092 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f77e3a3c-f0b8-456e-8d44-11567c801034 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:45.130528 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f77e3a3c-f0b8-456e-8d44-11567c801034 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:45.272228 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f77e3a3c-f0b8-456e-8d44-11567c801034 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:45.280286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f77e3a3c-f0b8-456e-8d44-11567c801034 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.165170 May 13 14:59:45.280859 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 292/609] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:45 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:45.711015 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-cce5b18f-7850-4adb-ad4f-c6800c71f18a tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:45.711616 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-cce5b18f-7850-4adb-ad4f-c6800c71f18a tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:45.718628 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cce5b18f-7850-4adb-ad4f-c6800c71f18a tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:45.719076 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cce5b18f-7850-4adb-ad4f-c6800c71f18a tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:45.719850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cce5b18f-7850-4adb-ad4f-c6800c71f18a tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:45.720315 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cce5b18f-7850-4adb-ad4f-c6800c71f18a tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:45.865413 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-cce5b18f-7850-4adb-ad4f-c6800c71f18a tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:45.873347 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-cce5b18f-7850-4adb-ad4f-c6800c71f18a tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1513 microversion: 2.1 time: 0.166358 May 13 14:59:45.874094 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 318/610] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:45 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:46.297778 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7b56e54b-8241-42b1-8a08-90e4422f86aa tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:46.298414 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7b56e54b-8241-42b1-8a08-90e4422f86aa tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:46.305098 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7b56e54b-8241-42b1-8a08-90e4422f86aa tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:46.305556 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7b56e54b-8241-42b1-8a08-90e4422f86aa tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:46.306310 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7b56e54b-8241-42b1-8a08-90e4422f86aa tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:46.306776 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7b56e54b-8241-42b1-8a08-90e4422f86aa tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:46.387535 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-6b7e2623-a83b-4307-be77-e4f3c6ecd971 req-d49ddf0f-0bae-41dc-9185-e8444f95217f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e0a674-f5d3-4352-9e65-b7b341d13011", "name": "network-vif-deleted", "tag": "f57376c8-5dfd-4194-81c7-881b55e976fe"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:59:46.396053 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-6b7e2623-a83b-4307-be77-e4f3c6ecd971 req-d49ddf0f-0bae-41dc-9185-e8444f95217f service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:46.396503 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-6b7e2623-a83b-4307-be77-e4f3c6ecd971 req-d49ddf0f-0bae-41dc-9185-e8444f95217f service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:46.407656 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-6b7e2623-a83b-4307-be77-e4f3c6ecd971 req-d49ddf0f-0bae-41dc-9185-e8444f95217f service nova] Creating event network-vif-deleted:f57376c8-5dfd-4194-81c7-881b55e976fe for instance 03e0a674-f5d3-4352-9e65-b7b341d13011 on hv-cinder-83090 May 13 14:59:46.412821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-6b7e2623-a83b-4307-be77-e4f3c6ecd971 req-d49ddf0f-0bae-41dc-9185-e8444f95217f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098972 May 13 14:59:46.413650 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 319/611] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 14:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:59:46.454259 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7b56e54b-8241-42b1-8a08-90e4422f86aa tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:46.463997 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7b56e54b-8241-42b1-8a08-90e4422f86aa tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.170257 May 13 14:59:46.464812 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 293/612] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:46 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:46.891624 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-8d3916ff-3420-4eff-bd2b-af9268bfbe19 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:46.892441 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-8d3916ff-3420-4eff-bd2b-af9268bfbe19 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:46.899371 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8d3916ff-3420-4eff-bd2b-af9268bfbe19 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:46.899896 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8d3916ff-3420-4eff-bd2b-af9268bfbe19 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:46.900728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8d3916ff-3420-4eff-bd2b-af9268bfbe19 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:46.901216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8d3916ff-3420-4eff-bd2b-af9268bfbe19 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:46.933707 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8d3916ff-3420-4eff-bd2b-af9268bfbe19 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:46.934171 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8d3916ff-3420-4eff-bd2b-af9268bfbe19 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:46.934649 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-8d3916ff-3420-4eff-bd2b-af9268bfbe19 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lazy-loading 'fault' on Instance uuid 03e0a674-f5d3-4352-9e65-b7b341d13011 {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:59:46.977243 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-8d3916ff-3420-4eff-bd2b-af9268bfbe19 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08b114f5b57146d8b4324231982ce7d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cf795995a52452f93da8f04eb878e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:46.986096 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-8d3916ff-3420-4eff-bd2b-af9268bfbe19 tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 200 len: 1309 microversion: 2.1 time: 0.099230 May 13 14:59:46.986686 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 320/613] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:46 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:47.486538 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-98d46c9a-a74e-44ed-a548-744bd92f132d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:47.487121 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-98d46c9a-a74e-44ed-a548-744bd92f132d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:47.494288 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-98d46c9a-a74e-44ed-a548-744bd92f132d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:47.494736 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-98d46c9a-a74e-44ed-a548-744bd92f132d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:47.495519 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-98d46c9a-a74e-44ed-a548-744bd92f132d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:47.495990 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-98d46c9a-a74e-44ed-a548-744bd92f132d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:47.640678 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-98d46c9a-a74e-44ed-a548-744bd92f132d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:47.649430 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-98d46c9a-a74e-44ed-a548-744bd92f132d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.168957 May 13 14:59:47.650017 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 294/614] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:47 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:48.006747 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ad1b1805-eb56-43f7-bc91-db3812c79bfd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:48.007388 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ad1b1805-eb56-43f7-bc91-db3812c79bfd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] [instance: 03e0a674-f5d3-4352-9e65-b7b341d13011] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:48.015025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ad1b1805-eb56-43f7-bc91-db3812c79bfd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:48.015582 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ad1b1805-eb56-43f7-bc91-db3812c79bfd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:48.016489 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ad1b1805-eb56-43f7-bc91-db3812c79bfd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:48.016974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ad1b1805-eb56-43f7-bc91-db3812c79bfd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:48.032329 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-ad1b1805-eb56-43f7-bc91-db3812c79bfd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] HTTP exception thrown: Instance 03e0a674-f5d3-4352-9e65-b7b341d13011 could not be found. May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ad1b1805-eb56-43f7-bc91-db3812c79bfd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Request method failure captured: May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 HTTP/1.1 May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnG_IuZXpKXhwp1CEGY7AAIqjEOgNH2wAA69z6YCwaBmIvry8g34LdHMlriwjfsQ1JraPdrwzHBIh-ElnYQShuzQd8xlp2dVkO0rlTloVV4cz92R1T8HvYtQtn_Tqj4rRxH608ampJAuEmlEW_SlCVHbZgudCiKGqBUQXaTO8YMRcpk May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 9cf795995a52452f93da8f04eb878e7b May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-VolumesSnapshotTestJSON-313197531 May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 14:59:48.033963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 14:59:48.035481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9cf795995a52452f93da8f04eb878e7b", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9cf795995a52452f93da8f04eb878e7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9cf795995a52452f93da8f04eb878e7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9cf795995a52452f93da8f04eb878e7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 14:59:48.035481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-VolumesSnapshotTestJSON-313197531 May 13 14:59:48.035481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 9cf795995a52452f93da8f04eb878e7b May 13 14:59:48.035481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-313197531 May 13 14:59:48.035481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-VolumesSnapshotTestJSON-313197531-project May 13 14:59:48.035481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 14:59:48.035481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 14:59:48.035481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 08b114f5b57146d8b4324231982ce7d4 May 13 14:59:48.035481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-VolumesSnapshotTestJSON-313197531-project May 13 14:59:48.035481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 14:59:48.035481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 03e0a674-f5d3-4352-9e65-b7b341d13011 could not be found. May 13 14:59:48.035481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '03e0a674-f5d3-4352-9e65-b7b341d13011'} May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e0a674-f5d3-4352-9e65-b7b341d13011 could not be found. May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:59:48.036297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e0a674-f5d3-4352-9e65-b7b341d13011 could not be found. May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e0a674-f5d3-4352-9e65-b7b341d13011 could not be found. May 13 14:59:48.037603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 14:59:48.038695 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ad1b1805-eb56-43f7-bc91-db3812c79bfd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] Returning 404 to user: Instance 03e0a674-f5d3-4352-9e65-b7b341d13011 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:59:48.038695 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ad1b1805-eb56-43f7-bc91-db3812c79bfd tempest-VolumesSnapshotTestJSON-313197531 tempest-VolumesSnapshotTestJSON-313197531-project] 10.222.0.99 "GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011" status: 404 len: 111 microversion: 2.1 time: 0.032905 May 13 14:59:48.038695 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 321/615] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:48 2022] GET /compute/v2.1/servers/03e0a674-f5d3-4352-9e65-b7b341d13011 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:59:48.671049 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1aad615c-6cce-4ffc-829e-abf366774d35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:48.671923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1aad615c-6cce-4ffc-829e-abf366774d35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:48.682809 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1aad615c-6cce-4ffc-829e-abf366774d35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:48.683538 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1aad615c-6cce-4ffc-829e-abf366774d35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:48.684845 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1aad615c-6cce-4ffc-829e-abf366774d35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:48.685561 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1aad615c-6cce-4ffc-829e-abf366774d35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:48.828428 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1aad615c-6cce-4ffc-829e-abf366774d35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:48.840708 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1aad615c-6cce-4ffc-829e-abf366774d35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.175870 May 13 14:59:48.841471 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 295/616] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:48 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:49.862848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-5013d23e-2143-4b28-9ae8-81fab2053fca tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:49.863425 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-5013d23e-2143-4b28-9ae8-81fab2053fca tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:49.870291 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5013d23e-2143-4b28-9ae8-81fab2053fca tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:49.870741 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5013d23e-2143-4b28-9ae8-81fab2053fca tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:49.871516 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5013d23e-2143-4b28-9ae8-81fab2053fca tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:49.871985 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5013d23e-2143-4b28-9ae8-81fab2053fca tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:50.018442 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-5013d23e-2143-4b28-9ae8-81fab2053fca tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:50.026943 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-5013d23e-2143-4b28-9ae8-81fab2053fca tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.170238 May 13 14:59:50.027512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 322/617] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:49 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:51.044707 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-930022f3-38d9-40aa-9f2a-ce163f16ec35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:51.045327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-930022f3-38d9-40aa-9f2a-ce163f16ec35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:51.052796 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-930022f3-38d9-40aa-9f2a-ce163f16ec35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:51.053260 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-930022f3-38d9-40aa-9f2a-ce163f16ec35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:51.054064 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-930022f3-38d9-40aa-9f2a-ce163f16ec35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:51.054511 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-930022f3-38d9-40aa-9f2a-ce163f16ec35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:51.196154 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-930022f3-38d9-40aa-9f2a-ce163f16ec35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:51.204551 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-930022f3-38d9-40aa-9f2a-ce163f16ec35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.164033 May 13 14:59:51.205161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 296/618] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:51 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:52.224667 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-77609e26-35f3-438e-9e54-dcc631e7c098 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:52.225300 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-77609e26-35f3-438e-9e54-dcc631e7c098 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:52.232784 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-77609e26-35f3-438e-9e54-dcc631e7c098 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:52.233255 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-77609e26-35f3-438e-9e54-dcc631e7c098 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:52.234057 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-77609e26-35f3-438e-9e54-dcc631e7c098 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:52.234508 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-77609e26-35f3-438e-9e54-dcc631e7c098 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:52.369012 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-77609e26-35f3-438e-9e54-dcc631e7c098 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:52.377875 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-77609e26-35f3-438e-9e54-dcc631e7c098 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.157383 May 13 14:59:52.378421 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 323/619] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:52 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:53.403593 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3447af11-eebb-4855-a118-6a0f84d46143 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:53.404690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-3447af11-eebb-4855-a118-6a0f84d46143 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:53.415997 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3447af11-eebb-4855-a118-6a0f84d46143 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:53.416743 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3447af11-eebb-4855-a118-6a0f84d46143 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:53.418020 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3447af11-eebb-4855-a118-6a0f84d46143 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:53.418731 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3447af11-eebb-4855-a118-6a0f84d46143 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:53.568524 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3447af11-eebb-4855-a118-6a0f84d46143 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:53.581042 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-3447af11-eebb-4855-a118-6a0f84d46143 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.183815 May 13 14:59:53.581801 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 297/620] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:53 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:54.607751 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d3ddffce-b40d-4765-96a3-c89122cf7457 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:54.608638 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d3ddffce-b40d-4765-96a3-c89122cf7457 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:54.619606 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d3ddffce-b40d-4765-96a3-c89122cf7457 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:54.620410 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d3ddffce-b40d-4765-96a3-c89122cf7457 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:54.621693 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d3ddffce-b40d-4765-96a3-c89122cf7457 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:54.622428 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d3ddffce-b40d-4765-96a3-c89122cf7457 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:54.759525 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d3ddffce-b40d-4765-96a3-c89122cf7457 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:54.768151 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d3ddffce-b40d-4765-96a3-c89122cf7457 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.167215 May 13 14:59:54.768767 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 324/621] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:54 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:55.789474 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-d21432c4-796f-4cca-b99c-4204f1245dbe tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:55.790304 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-d21432c4-796f-4cca-b99c-4204f1245dbe tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:55.800133 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d21432c4-796f-4cca-b99c-4204f1245dbe tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:55.800582 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d21432c4-796f-4cca-b99c-4204f1245dbe tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:55.801351 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d21432c4-796f-4cca-b99c-4204f1245dbe tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:55.801781 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d21432c4-796f-4cca-b99c-4204f1245dbe tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:55.956000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-d21432c4-796f-4cca-b99c-4204f1245dbe tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:55.963877 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-d21432c4-796f-4cca-b99c-4204f1245dbe tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.181268 May 13 14:59:55.964485 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 298/622] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:55 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:56.982790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-59185be3-60cd-4003-b168-33453a072157 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:56.983445 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-59185be3-60cd-4003-b168-33453a072157 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:56.990304 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-59185be3-60cd-4003-b168-33453a072157 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:56.990746 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-59185be3-60cd-4003-b168-33453a072157 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:56.991516 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-59185be3-60cd-4003-b168-33453a072157 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:56.991971 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-59185be3-60cd-4003-b168-33453a072157 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:57.138145 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-59185be3-60cd-4003-b168-33453a072157 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:57.146668 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-59185be3-60cd-4003-b168-33453a072157 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.168401 May 13 14:59:57.147250 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 325/623] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:56 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:58.167490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-924bc102-909e-4f96-91ec-72e2dcc2d14f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:58.168485 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-924bc102-909e-4f96-91ec-72e2dcc2d14f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:58.177447 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-924bc102-909e-4f96-91ec-72e2dcc2d14f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:58.177894 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-924bc102-909e-4f96-91ec-72e2dcc2d14f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:58.178658 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-924bc102-909e-4f96-91ec-72e2dcc2d14f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:58.179086 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-924bc102-909e-4f96-91ec-72e2dcc2d14f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:58.318206 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-924bc102-909e-4f96-91ec-72e2dcc2d14f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:58.326213 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-924bc102-909e-4f96-91ec-72e2dcc2d14f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.165028 May 13 14:59:58.326783 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 299/624] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:58 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:59:59.346811 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-80849e98-07f5-43c4-a38d-25c73936ba35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:59:59.348114 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-80849e98-07f5-43c4-a38d-25c73936ba35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:59:59.358861 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-80849e98-07f5-43c4-a38d-25c73936ba35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:59.359506 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-80849e98-07f5-43c4-a38d-25c73936ba35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:59.360851 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-80849e98-07f5-43c4-a38d-25c73936ba35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:59:59.361677 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-80849e98-07f5-43c4-a38d-25c73936ba35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:59:59.498967 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-80849e98-07f5-43c4-a38d-25c73936ba35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:59:59.507441 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-80849e98-07f5-43c4-a38d-25c73936ba35 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.167308 May 13 14:59:59.508058 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 326/625] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 14:59:59 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:00.525052 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-d02ea297-dae6-42ec-a0dd-574005c1959d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:00.525653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-d02ea297-dae6-42ec-a0dd-574005c1959d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:00.532625 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d02ea297-dae6-42ec-a0dd-574005c1959d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:00.533068 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d02ea297-dae6-42ec-a0dd-574005c1959d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:00.533828 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d02ea297-dae6-42ec-a0dd-574005c1959d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:00.534260 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d02ea297-dae6-42ec-a0dd-574005c1959d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:00.686181 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-d02ea297-dae6-42ec-a0dd-574005c1959d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:00.695184 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-d02ea297-dae6-42ec-a0dd-574005c1959d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.174097 May 13 15:00:00.695766 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 300/626] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:00 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:01.716856 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-fdd3a02d-4c24-429d-aae8-77987ebd8b32 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:01.717883 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-fdd3a02d-4c24-429d-aae8-77987ebd8b32 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:01.728710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fdd3a02d-4c24-429d-aae8-77987ebd8b32 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:01.729450 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fdd3a02d-4c24-429d-aae8-77987ebd8b32 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:01.731103 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fdd3a02d-4c24-429d-aae8-77987ebd8b32 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:01.731838 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fdd3a02d-4c24-429d-aae8-77987ebd8b32 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:01.869467 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-fdd3a02d-4c24-429d-aae8-77987ebd8b32 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:01.877502 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-fdd3a02d-4c24-429d-aae8-77987ebd8b32 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.167154 May 13 15:00:01.878075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 327/627] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:01 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:02.894604 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-246bd7ca-6d77-4663-aae2-8b79e56d8725 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:02.895334 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-246bd7ca-6d77-4663-aae2-8b79e56d8725 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:02.901942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-246bd7ca-6d77-4663-aae2-8b79e56d8725 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:02.902387 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-246bd7ca-6d77-4663-aae2-8b79e56d8725 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:02.903158 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-246bd7ca-6d77-4663-aae2-8b79e56d8725 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:02.903616 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-246bd7ca-6d77-4663-aae2-8b79e56d8725 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:03.041571 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-246bd7ca-6d77-4663-aae2-8b79e56d8725 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:03.050211 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-246bd7ca-6d77-4663-aae2-8b79e56d8725 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.159459 May 13 15:00:03.050797 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 301/628] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:02 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:04.077154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-bf467404-53d2-42f1-9470-1f90d82ad035 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:04.078115 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-bf467404-53d2-42f1-9470-1f90d82ad035 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:04.087321 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf467404-53d2-42f1-9470-1f90d82ad035 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:04.087767 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf467404-53d2-42f1-9470-1f90d82ad035 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:04.088708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf467404-53d2-42f1-9470-1f90d82ad035 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:04.089015 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf467404-53d2-42f1-9470-1f90d82ad035 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:04.223459 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-bf467404-53d2-42f1-9470-1f90d82ad035 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:04.231756 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-bf467404-53d2-42f1-9470-1f90d82ad035 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.161646 May 13 15:00:04.232336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 328/629] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:04 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:05.257763 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f2ae4568-5f65-4a64-a751-fa216f66d52f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:05.257763 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f2ae4568-5f65-4a64-a751-fa216f66d52f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:05.264789 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f2ae4568-5f65-4a64-a751-fa216f66d52f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:05.265049 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f2ae4568-5f65-4a64-a751-fa216f66d52f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:05.265858 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f2ae4568-5f65-4a64-a751-fa216f66d52f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:05.266493 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f2ae4568-5f65-4a64-a751-fa216f66d52f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:05.396894 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f2ae4568-5f65-4a64-a751-fa216f66d52f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:05.404843 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f2ae4568-5f65-4a64-a751-fa216f66d52f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.154065 May 13 15:00:05.405402 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 302/630] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:05 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 15:00:05.774876 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3019174e-291e-4bdb-94c4-7997cb650d09 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:05.775365 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3019174e-291e-4bdb-94c4-7997cb650d09 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:05.781430 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3019174e-291e-4bdb-94c4-7997cb650d09 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:05.781871 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3019174e-291e-4bdb-94c4-7997cb650d09 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:05.782634 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3019174e-291e-4bdb-94c4-7997cb650d09 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:05.783060 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3019174e-291e-4bdb-94c4-7997cb650d09 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:05.870404 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-3019174e-291e-4bdb-94c4-7997cb650d09 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lazy-loading 'services' on Instance uuid 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:00:05.949233 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3019174e-291e-4bdb-94c4-7997cb650d09 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "DELETE /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/os-volume_attachments/063d8258-1558-4c9b-af0c-fdacbe680d9e" status: 202 len: 0 microversion: 2.1 time: 0.288236 May 13 15:00:05.949821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 329/631] 10.222.0.99 () {58 vars in 1415 bytes} [Fri May 13 15:00:05 2022] DELETE /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/os-volume_attachments/063d8258-1558-4c9b-af0c-fdacbe680d9e => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:00:06.422264 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1dda0f7e-1bad-4ab6-a835-b2f0479b811f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:06.422874 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1dda0f7e-1bad-4ab6-a835-b2f0479b811f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:06.429532 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1dda0f7e-1bad-4ab6-a835-b2f0479b811f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:06.429965 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1dda0f7e-1bad-4ab6-a835-b2f0479b811f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:06.430736 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1dda0f7e-1bad-4ab6-a835-b2f0479b811f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:06.431162 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1dda0f7e-1bad-4ab6-a835-b2f0479b811f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:06.564776 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1dda0f7e-1bad-4ab6-a835-b2f0479b811f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:06.573708 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1dda0f7e-1bad-4ab6-a835-b2f0479b811f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.155294 May 13 15:00:06.574552 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 303/632] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:06 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:07.591913 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-aaa3636e-bff7-40c7-b63f-030bba22db0d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:07.592661 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-aaa3636e-bff7-40c7-b63f-030bba22db0d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:07.599196 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-aaa3636e-bff7-40c7-b63f-030bba22db0d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:07.599898 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-aaa3636e-bff7-40c7-b63f-030bba22db0d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:07.601113 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-aaa3636e-bff7-40c7-b63f-030bba22db0d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:07.601313 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-aaa3636e-bff7-40c7-b63f-030bba22db0d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:07.745656 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-aaa3636e-bff7-40c7-b63f-030bba22db0d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:07.754078 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-aaa3636e-bff7-40c7-b63f-030bba22db0d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1736 microversion: 2.1 time: 0.166903 May 13 15:00:07.754692 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 330/633] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:07 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:08.772926 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7a87d9d4-2b61-44cc-a0f1-6a991659b160 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:08.773571 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7a87d9d4-2b61-44cc-a0f1-6a991659b160 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:08.779831 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7a87d9d4-2b61-44cc-a0f1-6a991659b160 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:08.780309 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7a87d9d4-2b61-44cc-a0f1-6a991659b160 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:08.781083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7a87d9d4-2b61-44cc-a0f1-6a991659b160 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:08.781550 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7a87d9d4-2b61-44cc-a0f1-6a991659b160 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:08.916600 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7a87d9d4-2b61-44cc-a0f1-6a991659b160 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:08.925118 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7a87d9d4-2b61-44cc-a0f1-6a991659b160 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1716 microversion: 2.1 time: 0.156472 May 13 15:00:08.925668 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 304/634] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:08 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:08.985578 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-41a7a482-df9e-404e-b88c-412df828ad28 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:08.986132 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-41a7a482-df9e-404e-b88c-412df828ad28 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:08.992632 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-41a7a482-df9e-404e-b88c-412df828ad28 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:08.993084 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-41a7a482-df9e-404e-b88c-412df828ad28 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:08.993862 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-41a7a482-df9e-404e-b88c-412df828ad28 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:08.994300 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-41a7a482-df9e-404e-b88c-412df828ad28 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:09.076500 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-41a7a482-df9e-404e-b88c-412df828ad28 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] HTTP exception thrown: Cannot 'detach_volume' instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 while it is in vm_state rescued May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-41a7a482-df9e-404e-b88c-412df828ad28 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Request method failure captured: May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: DELETE /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/os-volume_attachments/bcf58ff9-7710-46c9-98a2-59b1032eeb67 HTTP/1.1 May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnEX_YCathXpRmMcmTHQK870dglSF1vIXxzMt9X_shkAAeZwK4OTEv8qG1yD9PbTZPRObjiSCwpvBFNAjyx-LTvGwuXfzsCenvc4jAiGwqb8FMR9nOVYkdImh9s_ciWTDSnHjkxjTZz4HRMjY3xYhYqIBKRc16CgA1qR8RAGN_F-tSg May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 55a6554838094ba8a8b807bd90ec5bf4 May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-427117176 May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:00:09.078154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:00:09.079465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a6554838094ba8a8b807bd90ec5bf4", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a6554838094ba8a8b807bd90ec5bf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a6554838094ba8a8b807bd90ec5bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a6554838094ba8a8b807bd90ec5bf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:00:09.079465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-ServerRescueNegativeTestJSON-427117176 May 13 15:00:09.079465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 55a6554838094ba8a8b807bd90ec5bf4 May 13 15:00:09.079465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-427117176 May 13 15:00:09.079465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-ServerRescueNegativeTestJSON-427117176-project May 13 15:00:09.079465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:00:09.079465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:00:09.079465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 18907451ac014573ba51f5f5f3939381 May 13 15:00:09.079465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-ServerRescueNegativeTestJSON-427117176-project May 13 15:00:09.079465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:00:09.079465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Cannot 'detach_volume' instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 while it is in vm_state rescued May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'server_id': '15fd606f-6ebc-46d6-9fe8-bd7219c22f27', 'id': 'bcf58ff9-7710-46c9-98a2-59b1032eeb67'} May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:00:09.080168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:00:09.082077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 13 15:00:09.082077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 13 15:00:09.082077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 13 15:00:09.082077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 13 15:00:09.082077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 while it is in vm_state rescued May 13 15:00:09.082077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:09.082077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:00:09.082077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:09.082077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:00:09.082077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:00:09.082077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:00:09.082077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:00:09.082077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:00:09.082077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 while it is in vm_state rescued May 13 15:00:09.082077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:09.082077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-41a7a482-df9e-404e-b88c-412df828ad28 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Returning 409 to user: Cannot 'detach_volume' instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 while it is in vm_state rescued {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:00:09.083657 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-41a7a482-df9e-404e-b88c-412df828ad28 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "DELETE /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/os-volume_attachments/bcf58ff9-7710-46c9-98a2-59b1032eeb67" status: 409 len: 152 microversion: 2.1 time: 0.098238 May 13 15:00:09.083657 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 331/635] 10.222.0.99 () {58 vars in 1415 bytes} [Fri May 13 15:00:08 2022] DELETE /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/os-volume_attachments/bcf58ff9-7710-46c9-98a2-59b1032eeb67 => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 13 15:00:09.088961 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cea57ad0-4bb1-4e3b-a1fb-5acb363c8f7a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:09.089597 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-cea57ad0-4bb1-4e3b-a1fb-5acb363c8f7a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:09.096178 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cea57ad0-4bb1-4e3b-a1fb-5acb363c8f7a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:09.096623 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cea57ad0-4bb1-4e3b-a1fb-5acb363c8f7a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:09.097384 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cea57ad0-4bb1-4e3b-a1fb-5acb363c8f7a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:09.097811 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cea57ad0-4bb1-4e3b-a1fb-5acb363c8f7a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:09.165489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-cea57ad0-4bb1-4e3b-a1fb-5acb363c8f7a tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "POST /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/action" status: 202 len: 0 microversion: 2.1 time: 0.080358 May 13 15:00:09.166042 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 305/636] 10.222.0.99 () {60 vars in 1277 bytes} [Fri May 13 15:00:09 2022] POST /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:00:09.174212 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-7806a6c4-6217-4c10-b8ab-f23d147c3c3f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:09.174824 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-7806a6c4-6217-4c10-b8ab-f23d147c3c3f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:09.181146 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7806a6c4-6217-4c10-b8ab-f23d147c3c3f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:09.181567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7806a6c4-6217-4c10-b8ab-f23d147c3c3f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:09.182336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7806a6c4-6217-4c10-b8ab-f23d147c3c3f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:09.182767 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7806a6c4-6217-4c10-b8ab-f23d147c3c3f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:09.322284 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-7806a6c4-6217-4c10-b8ab-f23d147c3c3f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:09.331523 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-7806a6c4-6217-4c10-b8ab-f23d147c3c3f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1724 microversion: 2.1 time: 0.161057 May 13 15:00:09.332147 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 332/637] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:09 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 15:00:09.400125 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6557894b-e970-4f80-a151-b68609497ed1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:09.400770 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6557894b-e970-4f80-a151-b68609497ed1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:09.406959 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6557894b-e970-4f80-a151-b68609497ed1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:09.407404 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6557894b-e970-4f80-a151-b68609497ed1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:09.408230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6557894b-e970-4f80-a151-b68609497ed1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:09.408657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6557894b-e970-4f80-a151-b68609497ed1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:09.432876 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6557894b-e970-4f80-a151-b68609497ed1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893/ips" status: 200 len: 151 microversion: 2.1 time: 0.088896 May 13 15:00:09.433335 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 306/638] 10.222.0.99 () {58 vars in 1247 bytes} [Fri May 13 15:00:09 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893/ips => generated 151 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:00:09.444432 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e27b7f42-3791-4e22-9f84-d6f6402be520 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "864e8c99-20e3-4664-80b2-be57402af2f9"}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:09.445854 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e27b7f42-3791-4e22-9f84-d6f6402be520 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:09.452174 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e27b7f42-3791-4e22-9f84-d6f6402be520 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:09.452685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e27b7f42-3791-4e22-9f84-d6f6402be520 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:09.453465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e27b7f42-3791-4e22-9f84-d6f6402be520 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:09.453981 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e27b7f42-3791-4e22-9f84-d6f6402be520 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:09.534020 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-e27b7f42-3791-4e22-9f84-d6f6402be520 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] HTTP exception thrown: Invalid volume: volume 864e8c99-20e3-4664-80b2-be57402af2f9 is already attached to instances: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e27b7f42-3791-4e22-9f84-d6f6402be520 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Request method failure captured: May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: POST /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893/os-volume_attachments HTTP/1.1 May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 74 May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnETlq5ud0tLso0I4BZTgYxPV45uNUu133mcSZWQF8BrY5W-G7qjq44vNdtUOkhBY1NV_9YSUowwjJ-SwPRew__XdEJEaAD7-9rhSJZVxBqaksNyEovGIgePKTwhLV_b-Jq67lITHd9QMI2kWMsWgOPV6MBxPM4K-LIG_E6GaM8BRTg May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:00:09.535850 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:00:09.537308 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8ff6bdb0a99948698dc413c12b120b61", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:00:09.537308 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:00:09.537308 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:00:09.537308 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:00:09.537308 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:00:09.537308 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:00:09.537308 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:00:09.537308 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 1ded6e90b10949dcb921119073f2d26a May 13 15:00:09.537308 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:00:09.537308 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: May 13 15:00:09.537308 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {"volumeAttachment": {"volumeId": "864e8c99-20e3-4664-80b2-be57402af2f9"}} May 13 15:00:09.537308 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Invalid volume: volume 864e8c99-20e3-4664-80b2-be57402af2f9 is already attached to instances: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'server_id': '8ea83690-7cf5-475e-9339-4bf228b48893', 'body': {'volumeAttachment': {'volumeId': '864e8c99-20e3-4664-80b2-be57402af2f9'}}} May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 864e8c99-20e3-4664-80b2-be57402af2f9 is already attached to instances: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:09.538163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 864e8c99-20e3-4664-80b2-be57402af2f9 is already attached to instances: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:00:09.540275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:00:09.541552 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:00:09.541552 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:00:09.541552 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:00:09.541552 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 864e8c99-20e3-4664-80b2-be57402af2f9 is already attached to instances: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 May 13 15:00:09.541552 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:09.541552 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e27b7f42-3791-4e22-9f84-d6f6402be520 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Returning 400 to user: Invalid volume: volume 864e8c99-20e3-4664-80b2-be57402af2f9 is already attached to instances: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:00:09.541552 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e27b7f42-3791-4e22-9f84-d6f6402be520 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "POST /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097044 May 13 15:00:09.541552 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 333/639] 10.222.0.99 () {60 vars in 1322 bytes} [Fri May 13 15:00:09 2022] POST /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 15:00:09.547406 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b51f4d41-5fa9-4f3a-9718-e1922a3941bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:09.547933 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b51f4d41-5fa9-4f3a-9718-e1922a3941bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:09.554078 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b51f4d41-5fa9-4f3a-9718-e1922a3941bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:09.554574 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b51f4d41-5fa9-4f3a-9718-e1922a3941bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:09.555581 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b51f4d41-5fa9-4f3a-9718-e1922a3941bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:09.556040 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b51f4d41-5fa9-4f3a-9718-e1922a3941bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:09.586880 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b51f4d41-5fa9-4f3a-9718-e1922a3941bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Going to try to terminate instance {{(pid=117296) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 15:00:09.672030 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b51f4d41-5fa9-4f3a-9718-e1922a3941bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "DELETE /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 204 len: 0 microversion: 2.1 time: 0.129029 May 13 15:00:09.672714 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 307/640] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:00:09 2022] DELETE /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 15:00:09.681888 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-93a3aaa2-37c6-4e60-9bd8-b23ab02ff269 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:09.682506 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-93a3aaa2-37c6-4e60-9bd8-b23ab02ff269 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:09.689933 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-93a3aaa2-37c6-4e60-9bd8-b23ab02ff269 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:09.690387 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-93a3aaa2-37c6-4e60-9bd8-b23ab02ff269 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:09.691220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-93a3aaa2-37c6-4e60-9bd8-b23ab02ff269 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:09.691658 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-93a3aaa2-37c6-4e60-9bd8-b23ab02ff269 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:09.828602 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-93a3aaa2-37c6-4e60-9bd8-b23ab02ff269 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:09.836963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-93a3aaa2-37c6-4e60-9bd8-b23ab02ff269 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1681 microversion: 2.1 time: 0.159484 May 13 15:00:09.837541 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 334/641] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:09 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:10.236732 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8e038a05-edc8-4840-9108-e18ad520cdec tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:10.243910 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8e038a05-edc8-4840-9108-e18ad520cdec tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:10.244353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8e038a05-edc8-4840-9108-e18ad520cdec tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:10.267001 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8e038a05-edc8-4840-9108-e18ad520cdec tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Going to try to stop instance {{(pid=117296) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 13 15:00:10.318071 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8e038a05-edc8-4840-9108-e18ad520cdec tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "POST /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/action" status: 202 len: 0 microversion: 2.1 time: 0.085424 May 13 15:00:10.318667 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 308/642] 10.222.0.99 () {60 vars in 1277 bytes} [Fri May 13 15:00:10 2022] POST /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:00:10.327251 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4610bdb0-e831-43f9-b7a8-a7ffc4b318ba tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:10.328299 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4610bdb0-e831-43f9-b7a8-a7ffc4b318ba tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:10.334428 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4610bdb0-e831-43f9-b7a8-a7ffc4b318ba tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:10.334881 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4610bdb0-e831-43f9-b7a8-a7ffc4b318ba tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:10.336379 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4610bdb0-e831-43f9-b7a8-a7ffc4b318ba tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:10.336822 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4610bdb0-e831-43f9-b7a8-a7ffc4b318ba tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:10.351138 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a581d75c-6577-4fa0-901c-d2edbf83c47d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:10.351914 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a581d75c-6577-4fa0-901c-d2edbf83c47d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:10.358771 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a581d75c-6577-4fa0-901c-d2edbf83c47d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:10.359215 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a581d75c-6577-4fa0-901c-d2edbf83c47d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:10.360008 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a581d75c-6577-4fa0-901c-d2edbf83c47d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:10.360436 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a581d75c-6577-4fa0-901c-d2edbf83c47d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:10.533379 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4610bdb0-e831-43f9-b7a8-a7ffc4b318ba tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:10.541958 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4610bdb0-e831-43f9-b7a8-a7ffc4b318ba tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1676 microversion: 2.1 time: 0.218488 May 13 15:00:10.542457 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 335/643] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:10 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:10.545702 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-a581d75c-6577-4fa0-901c-d2edbf83c47d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:10.554542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a581d75c-6577-4fa0-901c-d2edbf83c47d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1724 microversion: 2.1 time: 0.207687 May 13 15:00:10.555108 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 309/644] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:10 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:10.860011 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-6342fbe3-242f-41a2-9080-7d64939ea0d1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:10.861015 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-6342fbe3-242f-41a2-9080-7d64939ea0d1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:10.869705 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6342fbe3-242f-41a2-9080-7d64939ea0d1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:10.870151 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6342fbe3-242f-41a2-9080-7d64939ea0d1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:10.870918 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6342fbe3-242f-41a2-9080-7d64939ea0d1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:10.871342 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6342fbe3-242f-41a2-9080-7d64939ea0d1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:11.014406 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-6342fbe3-242f-41a2-9080-7d64939ea0d1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:11.021986 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-6342fbe3-242f-41a2-9080-7d64939ea0d1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1681 microversion: 2.1 time: 0.168837 May 13 15:00:11.023015 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 336/645] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:10 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:11.558809 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5e6629d6-aa8e-4f3f-abab-d7e0b20020dc tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:11.559397 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5e6629d6-aa8e-4f3f-abab-d7e0b20020dc tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:11.567089 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5e6629d6-aa8e-4f3f-abab-d7e0b20020dc tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:11.567544 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5e6629d6-aa8e-4f3f-abab-d7e0b20020dc tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:11.568361 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5e6629d6-aa8e-4f3f-abab-d7e0b20020dc tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:11.568799 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5e6629d6-aa8e-4f3f-abab-d7e0b20020dc tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:11.573081 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4bfc1609-f524-4ecb-9b49-5ede9f44c0f0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:11.573667 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4bfc1609-f524-4ecb-9b49-5ede9f44c0f0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:11.581234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4bfc1609-f524-4ecb-9b49-5ede9f44c0f0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:11.581670 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4bfc1609-f524-4ecb-9b49-5ede9f44c0f0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:11.582459 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4bfc1609-f524-4ecb-9b49-5ede9f44c0f0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:11.582903 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4bfc1609-f524-4ecb-9b49-5ede9f44c0f0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:11.762502 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5e6629d6-aa8e-4f3f-abab-d7e0b20020dc tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:11.771576 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5e6629d6-aa8e-4f3f-abab-d7e0b20020dc tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1676 microversion: 2.1 time: 0.216514 May 13 15:00:11.772248 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 310/646] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:11 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1676 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:11.793657 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4bfc1609-f524-4ecb-9b49-5ede9f44c0f0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:11.801515 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4bfc1609-f524-4ecb-9b49-5ede9f44c0f0 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1724 microversion: 2.1 time: 0.233438 May 13 15:00:11.802065 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 337/647] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:11 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:12.041279 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-836fdd45-0d77-4990-bee3-2e0eba8c9d5d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:12.041892 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-836fdd45-0d77-4990-bee3-2e0eba8c9d5d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:12.048182 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-836fdd45-0d77-4990-bee3-2e0eba8c9d5d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:12.048630 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-836fdd45-0d77-4990-bee3-2e0eba8c9d5d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:12.049397 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-836fdd45-0d77-4990-bee3-2e0eba8c9d5d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:12.049848 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-836fdd45-0d77-4990-bee3-2e0eba8c9d5d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:12.193488 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-836fdd45-0d77-4990-bee3-2e0eba8c9d5d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:12.202466 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-836fdd45-0d77-4990-bee3-2e0eba8c9d5d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1681 microversion: 2.1 time: 0.165171 May 13 15:00:12.203125 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 311/648] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:12 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:12.750679 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-9b3a965b-cd23-44af-ae21-3269e544e8ff req-a8f41aa1-3b3d-40b8-aea1-7edeb8cd2d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea83690-7cf5-475e-9339-4bf228b48893", "name": "network-vif-deleted", "tag": "05c9f616-6d8a-443a-adf5-507c9b933e77"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:12.759790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-9b3a965b-cd23-44af-ae21-3269e544e8ff req-a8f41aa1-3b3d-40b8-aea1-7edeb8cd2d2f service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:12.760558 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-9b3a965b-cd23-44af-ae21-3269e544e8ff req-a8f41aa1-3b3d-40b8-aea1-7edeb8cd2d2f service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:12.771704 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-9b3a965b-cd23-44af-ae21-3269e544e8ff req-a8f41aa1-3b3d-40b8-aea1-7edeb8cd2d2f service nova] Creating event network-vif-deleted:05c9f616-6d8a-443a-adf5-507c9b933e77 for instance 8ea83690-7cf5-475e-9339-4bf228b48893 on hv-cinder-83090 May 13 15:00:12.777055 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-9b3a965b-cd23-44af-ae21-3269e544e8ff req-a8f41aa1-3b3d-40b8-aea1-7edeb8cd2d2f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030172 May 13 15:00:12.778087 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 338/649] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:00:12.788940 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-2bda3995-a58c-4378-9f0b-192ba193f7fd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:12.789820 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-2bda3995-a58c-4378-9f0b-192ba193f7fd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:12.797363 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2bda3995-a58c-4378-9f0b-192ba193f7fd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:12.797812 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2bda3995-a58c-4378-9f0b-192ba193f7fd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:12.798596 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2bda3995-a58c-4378-9f0b-192ba193f7fd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:12.799027 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2bda3995-a58c-4378-9f0b-192ba193f7fd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:12.819037 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-655e45d9-3c75-4af7-b03f-a36709966b26 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:12.820080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-655e45d9-3c75-4af7-b03f-a36709966b26 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:12.826957 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-655e45d9-3c75-4af7-b03f-a36709966b26 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:12.827758 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-655e45d9-3c75-4af7-b03f-a36709966b26 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:12.828787 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-655e45d9-3c75-4af7-b03f-a36709966b26 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:12.829439 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-655e45d9-3c75-4af7-b03f-a36709966b26 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:12.998830 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-2bda3995-a58c-4378-9f0b-192ba193f7fd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:13.011057 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-655e45d9-3c75-4af7-b03f-a36709966b26 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:13.014567 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-2bda3995-a58c-4378-9f0b-192ba193f7fd tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1676 microversion: 2.1 time: 0.229460 May 13 15:00:13.015167 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 312/650] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:12 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 15:00:13.021361 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-655e45d9-3c75-4af7-b03f-a36709966b26 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1724 microversion: 2.1 time: 0.206453 May 13 15:00:13.028845 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 339/651] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:12 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 15:00:13.219893 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9fe0b407-83c3-4fa4-bf2d-33d50c10b86f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:13.220496 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-9fe0b407-83c3-4fa4-bf2d-33d50c10b86f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:13.226457 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9fe0b407-83c3-4fa4-bf2d-33d50c10b86f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:13.226900 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9fe0b407-83c3-4fa4-bf2d-33d50c10b86f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:13.227705 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9fe0b407-83c3-4fa4-bf2d-33d50c10b86f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:13.228309 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9fe0b407-83c3-4fa4-bf2d-33d50c10b86f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:13.296133 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9fe0b407-83c3-4fa4-bf2d-33d50c10b86f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:13.304964 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9fe0b407-83c3-4fa4-bf2d-33d50c10b86f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1615 microversion: 2.1 time: 0.088739 May 13 15:00:13.310314 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 313/652] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:13 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1615 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:14.031778 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-2579dd02-7c40-4eef-a206-eafe37d9d371 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:14.033874 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-2579dd02-7c40-4eef-a206-eafe37d9d371 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:14.038719 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7eec2f91-3e81-4424-8d5d-623283eaa71f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:14.039332 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7eec2f91-3e81-4424-8d5d-623283eaa71f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:14.040064 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2579dd02-7c40-4eef-a206-eafe37d9d371 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:14.040590 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2579dd02-7c40-4eef-a206-eafe37d9d371 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:14.041464 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2579dd02-7c40-4eef-a206-eafe37d9d371 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:14.041969 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2579dd02-7c40-4eef-a206-eafe37d9d371 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:14.045740 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7eec2f91-3e81-4424-8d5d-623283eaa71f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:14.046170 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7eec2f91-3e81-4424-8d5d-623283eaa71f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:14.047211 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7eec2f91-3e81-4424-8d5d-623283eaa71f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:14.047616 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7eec2f91-3e81-4424-8d5d-623283eaa71f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:14.282990 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-2579dd02-7c40-4eef-a206-eafe37d9d371 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:14.286401 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7eec2f91-3e81-4424-8d5d-623283eaa71f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:14.295760 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7eec2f91-3e81-4424-8d5d-623283eaa71f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1724 microversion: 2.1 time: 0.260873 May 13 15:00:14.300872 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-2579dd02-7c40-4eef-a206-eafe37d9d371 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1676 microversion: 2.1 time: 0.272967 May 13 15:00:14.302204 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 340/653] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:14 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1676 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:14.308147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 314/654] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:14 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:14.324227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-123ebcad-73e0-4d4a-a24d-90fd45570ab3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:14.324227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-123ebcad-73e0-4d4a-a24d-90fd45570ab3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:14.330798 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-123ebcad-73e0-4d4a-a24d-90fd45570ab3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:14.330798 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-123ebcad-73e0-4d4a-a24d-90fd45570ab3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:14.331151 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-123ebcad-73e0-4d4a-a24d-90fd45570ab3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:14.331822 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-123ebcad-73e0-4d4a-a24d-90fd45570ab3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:14.367231 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-123ebcad-73e0-4d4a-a24d-90fd45570ab3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:14.367808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-123ebcad-73e0-4d4a-a24d-90fd45570ab3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:14.368352 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-123ebcad-73e0-4d4a-a24d-90fd45570ab3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lazy-loading 'fault' on Instance uuid 8ea83690-7cf5-475e-9339-4bf228b48893 {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:00:14.422874 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-123ebcad-73e0-4d4a-a24d-90fd45570ab3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:14.432548 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-123ebcad-73e0-4d4a-a24d-90fd45570ab3 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 200 len: 1331 microversion: 2.1 time: 0.113821 May 13 15:00:14.433145 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 341/655] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:14 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:15.323017 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f026c3df-9369-4809-b284-aa553efdfe07 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:15.323606 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f026c3df-9369-4809-b284-aa553efdfe07 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:15.324841 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-504bd223-ae60-4690-a739-cdae279990e7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:15.325946 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-504bd223-ae60-4690-a739-cdae279990e7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:15.330341 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f026c3df-9369-4809-b284-aa553efdfe07 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:15.330874 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f026c3df-9369-4809-b284-aa553efdfe07 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:15.331731 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f026c3df-9369-4809-b284-aa553efdfe07 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:15.332287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f026c3df-9369-4809-b284-aa553efdfe07 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:15.333795 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-504bd223-ae60-4690-a739-cdae279990e7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:15.334208 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-504bd223-ae60-4690-a739-cdae279990e7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:15.335171 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-504bd223-ae60-4690-a739-cdae279990e7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:15.335757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-504bd223-ae60-4690-a739-cdae279990e7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:15.540811 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f026c3df-9369-4809-b284-aa553efdfe07 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:15.547106 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-504bd223-ae60-4690-a739-cdae279990e7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:15.555306 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-504bd223-ae60-4690-a739-cdae279990e7 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1730 microversion: 2.1 time: 0.234997 May 13 15:00:15.555535 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f026c3df-9369-4809-b284-aa553efdfe07 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1676 microversion: 2.1 time: 0.236558 May 13 15:00:15.555901 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 342/656] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:15 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:15.556291 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 315/657] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:15 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1676 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:15.561832 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-774f1e0f-0ce4-4ef8-bb4d-6585b43077ed tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:15.562430 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-774f1e0f-0ce4-4ef8-bb4d-6585b43077ed tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:15.569682 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-774f1e0f-0ce4-4ef8-bb4d-6585b43077ed tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:15.570372 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-774f1e0f-0ce4-4ef8-bb4d-6585b43077ed tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:15.571835 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-36322f9d-5623-4251-8eb9-ba598a0c11ae tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:15.572256 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-774f1e0f-0ce4-4ef8-bb4d-6585b43077ed tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:15.572488 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-36322f9d-5623-4251-8eb9-ba598a0c11ae tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:15.573144 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-774f1e0f-0ce4-4ef8-bb4d-6585b43077ed tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:15.579217 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-36322f9d-5623-4251-8eb9-ba598a0c11ae tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:15.579659 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-36322f9d-5623-4251-8eb9-ba598a0c11ae tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:15.580450 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-36322f9d-5623-4251-8eb9-ba598a0c11ae tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:15.580880 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-36322f9d-5623-4251-8eb9-ba598a0c11ae tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:15.590276 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-774f1e0f-0ce4-4ef8-bb4d-6585b43077ed tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] HTTP exception thrown: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-774f1e0f-0ce4-4ef8-bb4d-6585b43077ed tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Request method failure captured: May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 HTTP/1.1 May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnETlq5ud0tLso0I4BZTgYxPV45uNUu133mcSZWQF8BrY5W-G7qjq44vNdtUOkhBY1NV_9YSUowwjJ-SwPRew__XdEJEaAD7-9rhSJZVxBqaksNyEovGIgePKTwhLV_b-Jq67lITHd9QMI2kWMsWgOPV6MBxPM4K-LIG_E6GaM8BRTg May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:00:15.592226 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:00:15.593895 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8ff6bdb0a99948698dc413c12b120b61", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:00:15.593895 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:00:15.593895 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:00:15.593895 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:00:15.593895 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:00:15.593895 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:00:15.593895 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:00:15.593895 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 1ded6e90b10949dcb921119073f2d26a May 13 15:00:15.593895 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:00:15.593895 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:00:15.593895 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. May 13 15:00:15.593895 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '8ea83690-7cf5-475e-9339-4bf228b48893'} May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:00:15.594775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. May 13 15:00:15.596973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:15.598321 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-774f1e0f-0ce4-4ef8-bb4d-6585b43077ed tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Returning 404 to user: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:00:15.598413 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-774f1e0f-0ce4-4ef8-bb4d-6585b43077ed tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 404 len: 111 microversion: 2.1 time: 0.039327 May 13 15:00:15.599077 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 343/658] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:15 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:00:15.610746 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-cb267539-11eb-48da-b89d-a6e33b560279 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '.version_select at 0x7fcf4cb64e50>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:15.647746 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-cb267539-11eb-48da-b89d-a6e33b560279 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824062944" status: 202 len: 0 microversion: 2.1 time: 0.040319 May 13 15:00:15.648676 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 344/659] 10.222.0.99 () {58 vars in 1220 bytes} [Fri May 13 15:00:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824062944 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:00:15.675656 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-36322f9d-5623-4251-8eb9-ba598a0c11ae tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107542 May 13 15:00:15.676313 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 316/660] 10.222.0.99 () {58 vars in 1274 bytes} [Fri May 13 15:00:15 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:00:16.485663 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-450fe1ac-db47-4793-8df5-d9dde18040ea tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:16.486231 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-450fe1ac-db47-4793-8df5-d9dde18040ea tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:16.495230 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-450fe1ac-db47-4793-8df5-d9dde18040ea tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:16.495697 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-450fe1ac-db47-4793-8df5-d9dde18040ea tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:16.496499 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-450fe1ac-db47-4793-8df5-d9dde18040ea tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:16.496928 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-450fe1ac-db47-4793-8df5-d9dde18040ea tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:16.573657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3a84dcbf-04c4-42f5-96a1-d3a24c309cf2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:16.574250 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-3a84dcbf-04c4-42f5-96a1-d3a24c309cf2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:16.576082 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-450fe1ac-db47-4793-8df5-d9dde18040ea tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lazy-loading 'services' on Instance uuid 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:00:16.581113 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a84dcbf-04c4-42f5-96a1-d3a24c309cf2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:16.581492 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a84dcbf-04c4-42f5-96a1-d3a24c309cf2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:16.582273 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a84dcbf-04c4-42f5-96a1-d3a24c309cf2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:16.582704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3a84dcbf-04c4-42f5-96a1-d3a24c309cf2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:16.656753 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-450fe1ac-db47-4793-8df5-d9dde18040ea tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "DELETE /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7/os-volume_attachments/864e8c99-20e3-4664-80b2-be57402af2f9" status: 202 len: 0 microversion: 2.1 time: 0.175665 May 13 15:00:16.657346 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 345/661] 10.222.0.99 () {58 vars in 1415 bytes} [Fri May 13 15:00:16 2022] DELETE /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7/os-volume_attachments/864e8c99-20e3-4664-80b2-be57402af2f9 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:00:16.666860 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-876c0548-c53d-4e37-8b00-6fb7417f4284 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:16.667997 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-876c0548-c53d-4e37-8b00-6fb7417f4284 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:16.674592 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-876c0548-c53d-4e37-8b00-6fb7417f4284 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:16.675183 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-876c0548-c53d-4e37-8b00-6fb7417f4284 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:16.676009 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-876c0548-c53d-4e37-8b00-6fb7417f4284 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:16.676431 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-876c0548-c53d-4e37-8b00-6fb7417f4284 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:16.707910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-876c0548-c53d-4e37-8b00-6fb7417f4284 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045499 May 13 15:00:16.708425 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 346/662] 10.222.0.99 () {58 vars in 1301 bytes} [Fri May 13 15:00:16 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 15:00:17.034449 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3a84dcbf-04c4-42f5-96a1-d3a24c309cf2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:17.043340 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-3a84dcbf-04c4-42f5-96a1-d3a24c309cf2 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1676 microversion: 2.1 time: 0.474133 May 13 15:00:17.043947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 317/663] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:16 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1676 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:17.153568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-a08fffdd-689b-4163-9c00-0c99500d0a52 req-888b6528-d8c0-4efc-a766-be87e4122abb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15fd606f-6ebc-46d6-9fe8-bd7219c22f27", "tag": "751bef1d-e5f5-41a9-bbf3-44c2a5dc804c"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:17.161347 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-a08fffdd-689b-4163-9c00-0c99500d0a52 req-888b6528-d8c0-4efc-a766-be87e4122abb service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:17.161719 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-a08fffdd-689b-4163-9c00-0c99500d0a52 req-888b6528-d8c0-4efc-a766-be87e4122abb service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:17.172607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-a08fffdd-689b-4163-9c00-0c99500d0a52 req-888b6528-d8c0-4efc-a766-be87e4122abb service nova] Creating event network-changed:751bef1d-e5f5-41a9-bbf3-44c2a5dc804c for instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 on hv-cinder-83090 May 13 15:00:17.177569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-a08fffdd-689b-4163-9c00-0c99500d0a52 req-888b6528-d8c0-4efc-a766-be87e4122abb service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201326 May 13 15:00:17.178211 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 347/664] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 15:00:17.721029 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8c3b3738-dcb7-4845-90d3-53ed7a64ae2d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:17.722115 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8c3b3738-dcb7-4845-90d3-53ed7a64ae2d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:17.729601 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8c3b3738-dcb7-4845-90d3-53ed7a64ae2d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:17.730057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8c3b3738-dcb7-4845-90d3-53ed7a64ae2d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:17.731188 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8c3b3738-dcb7-4845-90d3-53ed7a64ae2d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:17.731613 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8c3b3738-dcb7-4845-90d3-53ed7a64ae2d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:17.762857 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8c3b3738-dcb7-4845-90d3-53ed7a64ae2d tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047836 May 13 15:00:17.763421 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 318/665] 10.222.0.99 () {58 vars in 1301 bytes} [Fri May 13 15:00:17 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 15:00:17.825422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-cffe06e4-a23e-49c6-8bd8-9e211279d2a5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:17.826005 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-cffe06e4-a23e-49c6-8bd8-9e211279d2a5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:17.832395 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cffe06e4-a23e-49c6-8bd8-9e211279d2a5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:17.832837 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cffe06e4-a23e-49c6-8bd8-9e211279d2a5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:17.833610 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cffe06e4-a23e-49c6-8bd8-9e211279d2a5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:17.834060 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cffe06e4-a23e-49c6-8bd8-9e211279d2a5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:17.860505 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-cffe06e4-a23e-49c6-8bd8-9e211279d2a5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Going to try to terminate instance {{(pid=117295) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 15:00:17.939345 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-cffe06e4-a23e-49c6-8bd8-9e211279d2a5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "DELETE /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 204 len: 0 microversion: 2.1 time: 0.118412 May 13 15:00:17.939902 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 348/666] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:00:17 2022] DELETE /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 15:00:17.948690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-99d80c8f-8e9d-42e6-b0d2-5c7583ba8348 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:17.949330 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-99d80c8f-8e9d-42e6-b0d2-5c7583ba8348 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:17.955752 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-99d80c8f-8e9d-42e6-b0d2-5c7583ba8348 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:17.956261 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-99d80c8f-8e9d-42e6-b0d2-5c7583ba8348 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:17.957071 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-99d80c8f-8e9d-42e6-b0d2-5c7583ba8348 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:17.957510 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-99d80c8f-8e9d-42e6-b0d2-5c7583ba8348 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:18.060722 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-945a739b-c4cd-478e-99c0-e6ec2501a284 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:18.061545 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-945a739b-c4cd-478e-99c0-e6ec2501a284 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:18.067995 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-945a739b-c4cd-478e-99c0-e6ec2501a284 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:18.068432 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-945a739b-c4cd-478e-99c0-e6ec2501a284 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:18.069249 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-945a739b-c4cd-478e-99c0-e6ec2501a284 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:18.069729 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-945a739b-c4cd-478e-99c0-e6ec2501a284 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:18.090476 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-99d80c8f-8e9d-42e6-b0d2-5c7583ba8348 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:18.098145 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-99d80c8f-8e9d-42e6-b0d2-5c7583ba8348 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1682 microversion: 2.1 time: 0.153861 May 13 15:00:18.098690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 319/667] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:17 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 15:00:18.199048 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-945a739b-c4cd-478e-99c0-e6ec2501a284 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:18.206966 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-945a739b-c4cd-478e-99c0-e6ec2501a284 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1676 microversion: 2.1 time: 0.150789 May 13 15:00:18.207543 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 349/668] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:18 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:19.116676 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-2eacb68c-02b9-4101-b3db-ab8dd419ce41 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:19.117308 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-2eacb68c-02b9-4101-b3db-ab8dd419ce41 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:19.125578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2eacb68c-02b9-4101-b3db-ab8dd419ce41 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:19.126029 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2eacb68c-02b9-4101-b3db-ab8dd419ce41 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:19.126813 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2eacb68c-02b9-4101-b3db-ab8dd419ce41 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:19.127244 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2eacb68c-02b9-4101-b3db-ab8dd419ce41 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:19.200712 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-f42d53df-32da-41d2-95bc-e1214857908d req-89425c88-3734-45fd-8d34-d99bcc292f1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15fd606f-6ebc-46d6-9fe8-bd7219c22f27", "tag": "751bef1d-e5f5-41a9-bbf3-44c2a5dc804c"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:19.208780 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-f42d53df-32da-41d2-95bc-e1214857908d req-89425c88-3734-45fd-8d34-d99bcc292f1a service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:19.209217 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-f42d53df-32da-41d2-95bc-e1214857908d req-89425c88-3734-45fd-8d34-d99bcc292f1a service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:19.220680 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-f42d53df-32da-41d2-95bc-e1214857908d req-89425c88-3734-45fd-8d34-d99bcc292f1a service nova] Creating event network-changed:751bef1d-e5f5-41a9-bbf3-44c2a5dc804c for instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 on hv-cinder-83090 May 13 15:00:19.226300 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-f42d53df-32da-41d2-95bc-e1214857908d req-89425c88-3734-45fd-8d34-d99bcc292f1a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029882 May 13 15:00:19.226876 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 350/669] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:00:19.232439 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-fc2218fa-d172-4491-88c8-60d2d7786fd0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:19.233418 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-fc2218fa-d172-4491-88c8-60d2d7786fd0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:19.239539 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fc2218fa-d172-4491-88c8-60d2d7786fd0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:19.240014 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fc2218fa-d172-4491-88c8-60d2d7786fd0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:19.240801 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fc2218fa-d172-4491-88c8-60d2d7786fd0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:19.241230 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fc2218fa-d172-4491-88c8-60d2d7786fd0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:19.279409 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-2eacb68c-02b9-4101-b3db-ab8dd419ce41 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:19.287791 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-2eacb68c-02b9-4101-b3db-ab8dd419ce41 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1682 microversion: 2.1 time: 0.174851 May 13 15:00:19.288589 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 320/670] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:19 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:19.376016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-fc2218fa-d172-4491-88c8-60d2d7786fd0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:19.384165 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-fc2218fa-d172-4491-88c8-60d2d7786fd0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1676 microversion: 2.1 time: 0.155905 May 13 15:00:19.384753 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 351/671] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:19 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:20.286193 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-5b241ffb-779b-4aa0-9fcd-fa1ed5b249a9 req-6bcd66d3-bdc8-46e4-8de9-948df4e4816d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137f45b0-0ba4-4c2e-8588-b45112a1c7d7", "name": "network-vif-deleted", "tag": "ee93aa72-1b63-48c8-bbd1-9a3c75bec1fe"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:20.295102 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-5b241ffb-779b-4aa0-9fcd-fa1ed5b249a9 req-6bcd66d3-bdc8-46e4-8de9-948df4e4816d service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:20.295813 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-5b241ffb-779b-4aa0-9fcd-fa1ed5b249a9 req-6bcd66d3-bdc8-46e4-8de9-948df4e4816d service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:20.306424 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c7d02bfe-c89d-4d38-b000-f3f0cb9d3fce tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:20.307026 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c7d02bfe-c89d-4d38-b000-f3f0cb9d3fce tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:20.310461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-5b241ffb-779b-4aa0-9fcd-fa1ed5b249a9 req-6bcd66d3-bdc8-46e4-8de9-948df4e4816d service nova] Creating event network-vif-deleted:ee93aa72-1b63-48c8-bbd1-9a3c75bec1fe for instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 on hv-cinder-83090 May 13 15:00:20.314759 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c7d02bfe-c89d-4d38-b000-f3f0cb9d3fce tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:20.315438 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c7d02bfe-c89d-4d38-b000-f3f0cb9d3fce tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:20.315950 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-5b241ffb-779b-4aa0-9fcd-fa1ed5b249a9 req-6bcd66d3-bdc8-46e4-8de9-948df4e4816d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033311 May 13 15:00:20.316982 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 321/672] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:00:20.319793 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c7d02bfe-c89d-4d38-b000-f3f0cb9d3fce tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:20.320298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c7d02bfe-c89d-4d38-b000-f3f0cb9d3fce tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:20.388945 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c7d02bfe-c89d-4d38-b000-f3f0cb9d3fce tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:20.396978 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c7d02bfe-c89d-4d38-b000-f3f0cb9d3fce tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 200 len: 1614 microversion: 2.1 time: 0.095116 May 13 15:00:20.398039 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 352/673] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:20 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 1614 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:20.404347 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f3ebb78e-03a8-4943-853d-2c7d08c4e86d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:20.405315 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f3ebb78e-03a8-4943-853d-2c7d08c4e86d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:20.411843 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f3ebb78e-03a8-4943-853d-2c7d08c4e86d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:20.412401 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f3ebb78e-03a8-4943-853d-2c7d08c4e86d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:20.413515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f3ebb78e-03a8-4943-853d-2c7d08c4e86d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:20.413974 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f3ebb78e-03a8-4943-853d-2c7d08c4e86d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:20.550384 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f3ebb78e-03a8-4943-853d-2c7d08c4e86d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:20.557852 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f3ebb78e-03a8-4943-853d-2c7d08c4e86d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1676 microversion: 2.1 time: 0.159643 May 13 15:00:20.558428 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 322/674] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:20 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 15:00:21.414060 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-23226767-3930-46c2-9f12-a8ddf4d07c75 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:21.414908 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-23226767-3930-46c2-9f12-a8ddf4d07c75 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:21.421725 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-23226767-3930-46c2-9f12-a8ddf4d07c75 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:21.422260 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-23226767-3930-46c2-9f12-a8ddf4d07c75 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:21.423117 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-23226767-3930-46c2-9f12-a8ddf4d07c75 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:21.423617 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-23226767-3930-46c2-9f12-a8ddf4d07c75 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:21.437890 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-23226767-3930-46c2-9f12-a8ddf4d07c75 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] HTTP exception thrown: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-23226767-3930-46c2-9f12-a8ddf4d07c75 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Request method failure captured: May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 HTTP/1.1 May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnETlq5ud0tLso0I4BZTgYxPV45uNUu133mcSZWQF8BrY5W-G7qjq44vNdtUOkhBY1NV_9YSUowwjJ-SwPRew__XdEJEaAD7-9rhSJZVxBqaksNyEovGIgePKTwhLV_b-Jq67lITHd9QMI2kWMsWgOPV6MBxPM4K-LIG_E6GaM8BRTg May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:00:21.439842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:00:21.441330 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8ff6bdb0a99948698dc413c12b120b61", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:00:21.441330 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:00:21.441330 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:00:21.441330 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:00:21.441330 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:00:21.441330 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:00:21.441330 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:00:21.441330 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 1ded6e90b10949dcb921119073f2d26a May 13 15:00:21.441330 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:00:21.441330 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:00:21.441330 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. May 13 15:00:21.441330 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '137f45b0-0ba4-4c2e-8588-b45112a1c7d7'} May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:00:21.442327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. May 13 15:00:21.443808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:00:21.445987 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-23226767-3930-46c2-9f12-a8ddf4d07c75 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Returning 404 to user: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:00:21.446877 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-23226767-3930-46c2-9f12-a8ddf4d07c75 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 404 len: 111 microversion: 2.1 time: 0.036806 May 13 15:00:21.447587 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 353/675] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:21 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:00:21.456176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-81065c84-07fa-4ba2-b078-3b5e558fba09 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '.version_select at 0x7fcf4805ea60>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:21.476170 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-81065c84-07fa-4ba2-b078-3b5e558fba09 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-925343145" status: 202 len: 0 microversion: 2.1 time: 0.023754 May 13 15:00:21.480057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 323/676] 10.222.0.99 () {58 vars in 1217 bytes} [Fri May 13 15:00:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-925343145 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:00:21.575753 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-168a4b45-4334-4218-a6d7-486b66f54a97 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:21.576413 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-168a4b45-4334-4218-a6d7-486b66f54a97 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:21.582373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-168a4b45-4334-4218-a6d7-486b66f54a97 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:21.582821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-168a4b45-4334-4218-a6d7-486b66f54a97 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:21.583592 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-168a4b45-4334-4218-a6d7-486b66f54a97 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:21.584063 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-168a4b45-4334-4218-a6d7-486b66f54a97 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:21.724389 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-168a4b45-4334-4218-a6d7-486b66f54a97 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:21.733219 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-168a4b45-4334-4218-a6d7-486b66f54a97 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1653 microversion: 2.1 time: 0.161974 May 13 15:00:21.733821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 354/677] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:21 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1653 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:21.750005 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ae4ad849-50cf-4464-9037-dd2aac2c1337 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:21.756415 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ae4ad849-50cf-4464-9037-dd2aac2c1337 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:21.756860 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ae4ad849-50cf-4464-9037-dd2aac2c1337 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:21.779953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ae4ad849-50cf-4464-9037-dd2aac2c1337 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Going to try to start instance {{(pid=117296) start /opt/stack/nova/nova/compute/api.py:2730}} May 13 15:00:21.823958 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ae4ad849-50cf-4464-9037-dd2aac2c1337 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "POST /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/action" status: 202 len: 0 microversion: 2.1 time: 0.077613 May 13 15:00:21.824635 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 324/678] 10.222.0.99 () {60 vars in 1277 bytes} [Fri May 13 15:00:21 2022] POST /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:00:21.832685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-67731bc4-6eff-45b4-bad6-f9668158e79b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:21.833290 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-67731bc4-6eff-45b4-bad6-f9668158e79b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:21.839169 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-67731bc4-6eff-45b4-bad6-f9668158e79b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:21.839973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-67731bc4-6eff-45b4-bad6-f9668158e79b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:21.840643 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-67731bc4-6eff-45b4-bad6-f9668158e79b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:21.841044 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-67731bc4-6eff-45b4-bad6-f9668158e79b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:21.991425 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-67731bc4-6eff-45b4-bad6-f9668158e79b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:22.000373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-67731bc4-6eff-45b4-bad6-f9668158e79b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1662 microversion: 2.1 time: 0.171390 May 13 15:00:22.001180 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 355/679] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:21 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1662 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:22.511066 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-baa0b2ee-3413-4f54-a386-f6d97943c7bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Action: 'create', calling method: .version_select at 0x7fcf4845a1f0>, body: {"keypair": {"name": "tempest-keypair-1274671663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCUiCBgztV6eINfl7Kz3+OHULp/1BePqTJG8AQcuOKwk24/f9/95MxPbtUuntNHW4eW48Dm5dF1z5b9DwS9594O2q+My5ASQ/XdofB5DCySZRWE1iYX3vObuSB/8VaqIA=="}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:22.526704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-baa0b2ee-3413-4f54-a386-f6d97943c7bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Getting quotas for project 8ff6bdb0a99948698dc413c12b120b61. Resources: {'key_pairs'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 15:00:22.530780 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-baa0b2ee-3413-4f54-a386-f6d97943c7bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Getting quotas for user 1ded6e90b10949dcb921119073f2d26a and project 8ff6bdb0a99948698dc413c12b120b61. Resources: {'key_pairs'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 15:00:22.555801 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-baa0b2ee-3413-4f54-a386-f6d97943c7bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049681 May 13 15:00:22.556441 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 325/680] 10.222.0.99 () {60 vars in 1158 bytes} [Fri May 13 15:00:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:00:23.018246 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f53bb974-5f32-480c-bf31-647a432f37d9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:23.018883 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f53bb974-5f32-480c-bf31-647a432f37d9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:23.025770 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f53bb974-5f32-480c-bf31-647a432f37d9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:23.026205 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f53bb974-5f32-480c-bf31-647a432f37d9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:23.027163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f53bb974-5f32-480c-bf31-647a432f37d9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:23.027612 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f53bb974-5f32-480c-bf31-647a432f37d9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:23.249141 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f53bb974-5f32-480c-bf31-647a432f37d9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:23.256754 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f53bb974-5f32-480c-bf31-647a432f37d9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1662 microversion: 2.1 time: 0.242580 May 13 15:00:23.257420 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 356/681] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:23 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1662 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:23.989397 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-10a0cb8a-8d9b-4020-83c3-1146ea9bb609 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1945866283", "imageRef": "eac0bc7b-d963-4624-aba3-a81fd1bf324c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "316a8fad-500e-494b-ad63-b6f37981c2d9"}], "security_groups": [{"name": "tempest-securitygroup--974794325"}], "key_name": "tempest-keypair-1274671663", "user_data": "}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:24.101017 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.network.neutron [None req-10a0cb8a-8d9b-4020-83c3-1146ea9bb609 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] validate_networks() for [('316a8fad-500e-494b-ad63-b6f37981c2d9', None, None, None, None, None)] {{(pid=117296) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 15:00:24.275668 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ddc80593-af1f-4ab3-8506-15f64f314187 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:24.276395 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ddc80593-af1f-4ab3-8506-15f64f314187 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:24.283223 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ddc80593-af1f-4ab3-8506-15f64f314187 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:24.283775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ddc80593-af1f-4ab3-8506-15f64f314187 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:24.284695 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ddc80593-af1f-4ab3-8506-15f64f314187 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:24.285203 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ddc80593-af1f-4ab3-8506-15f64f314187 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:24.466738 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ddc80593-af1f-4ab3-8506-15f64f314187 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:24.481027 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ddc80593-af1f-4ab3-8506-15f64f314187 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1666 microversion: 2.1 time: 0.209337 May 13 15:00:24.481536 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 357/682] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:24 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1666 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 15:00:24.603579 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-10a0cb8a-8d9b-4020-83c3-1146ea9bb609 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Flavor limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 15:00:24.604252 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-10a0cb8a-8d9b-4020-83c3-1146ea9bb609 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Image limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 15:00:24.604944 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-10a0cb8a-8d9b-4020-83c3-1146ea9bb609 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Flavor pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 15:00:24.605865 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-10a0cb8a-8d9b-4020-83c3-1146ea9bb609 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Image pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 15:00:24.606440 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-10a0cb8a-8d9b-4020-83c3-1146ea9bb609 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 15:00:24.619730 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-10a0cb8a-8d9b-4020-83c3-1146ea9bb609 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:24.620219 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-10a0cb8a-8d9b-4020-83c3-1146ea9bb609 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:24.621010 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-10a0cb8a-8d9b-4020-83c3-1146ea9bb609 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:24.621441 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-10a0cb8a-8d9b-4020-83c3-1146ea9bb609 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:24.638426 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-10a0cb8a-8d9b-4020-83c3-1146ea9bb609 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Getting quotas for project 8ff6bdb0a99948698dc413c12b120b61. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 15:00:24.642856 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-10a0cb8a-8d9b-4020-83c3-1146ea9bb609 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Getting quotas for user 1ded6e90b10949dcb921119073f2d26a and project 8ff6bdb0a99948698dc413c12b120b61. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 15:00:24.655344 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-10a0cb8a-8d9b-4020-83c3-1146ea9bb609 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Going to run 1 instances... {{(pid=117296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 15:00:24.657756 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-10a0cb8a-8d9b-4020-83c3-1146ea9bb609 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac0bc7b-d963-4624-aba3-a81fd1bf324c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 15:00:24.704350 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-10a0cb8a-8d9b-4020-83c3-1146ea9bb609 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.719718 May 13 15:00:24.705011 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 326/683] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 15:00:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 15:00:24.715211 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3de6144a-201f-433f-8d6d-0794cf67939e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:24.715892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3de6144a-201f-433f-8d6d-0794cf67939e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:24.769407 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3de6144a-201f-433f-8d6d-0794cf67939e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:24.776482 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3de6144a-201f-433f-8d6d-0794cf67939e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 200 len: 1242 microversion: 2.1 time: 0.065291 May 13 15:00:24.777032 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 358/684] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:24 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:25.794500 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-029aa7cd-b458-43b6-921f-a70096cd5be6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:25.795112 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-029aa7cd-b458-43b6-921f-a70096cd5be6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:25.802610 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-029aa7cd-b458-43b6-921f-a70096cd5be6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:25.803055 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-029aa7cd-b458-43b6-921f-a70096cd5be6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:25.803834 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-029aa7cd-b458-43b6-921f-a70096cd5be6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:25.804299 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-029aa7cd-b458-43b6-921f-a70096cd5be6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:25.876945 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-029aa7cd-b458-43b6-921f-a70096cd5be6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:25.884847 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-029aa7cd-b458-43b6-921f-a70096cd5be6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 200 len: 1294 microversion: 2.1 time: 0.094904 May 13 15:00:25.885437 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 327/685] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:25 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:26.903022 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-056784c7-1de7-4759-b4e1-07dd3792082a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:26.903793 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-056784c7-1de7-4759-b4e1-07dd3792082a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:26.910327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-056784c7-1de7-4759-b4e1-07dd3792082a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:26.910777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-056784c7-1de7-4759-b4e1-07dd3792082a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:26.911527 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-056784c7-1de7-4759-b4e1-07dd3792082a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:26.911987 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-056784c7-1de7-4759-b4e1-07dd3792082a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:27.055666 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-056784c7-1de7-4759-b4e1-07dd3792082a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:27.063230 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-056784c7-1de7-4759-b4e1-07dd3792082a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.164204 May 13 15:00:27.063807 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 359/686] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:26 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:27.445098 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-e7aa622f-282f-483c-9501-a1555171819a req-983b26a9-5e0b-4678-936c-e68109dc1a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf1ec1b0-5a88-48de-8329-bd0b9792b8d5", "tag": "5a1e18eb-74a1-4afa-9947-0dc5d10cc4f0"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:27.456132 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-e7aa622f-282f-483c-9501-a1555171819a req-983b26a9-5e0b-4678-936c-e68109dc1a02 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:27.456828 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-e7aa622f-282f-483c-9501-a1555171819a req-983b26a9-5e0b-4678-936c-e68109dc1a02 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:27.479639 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-e7aa622f-282f-483c-9501-a1555171819a req-983b26a9-5e0b-4678-936c-e68109dc1a02 service nova] Creating event network-changed:5a1e18eb-74a1-4afa-9947-0dc5d10cc4f0 for instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 on hv-cinder-83090 May 13 15:00:27.485376 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-e7aa622f-282f-483c-9501-a1555171819a req-983b26a9-5e0b-4678-936c-e68109dc1a02 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043639 May 13 15:00:27.486277 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 328/687] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:00:28.080075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-165fd5af-8e4a-48c8-910d-29c6ff80dd11 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:28.080715 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-165fd5af-8e4a-48c8-910d-29c6ff80dd11 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:28.087829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-165fd5af-8e4a-48c8-910d-29c6ff80dd11 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:28.088310 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-165fd5af-8e4a-48c8-910d-29c6ff80dd11 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:28.089097 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-165fd5af-8e4a-48c8-910d-29c6ff80dd11 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:28.089505 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-165fd5af-8e4a-48c8-910d-29c6ff80dd11 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:28.226220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-165fd5af-8e4a-48c8-910d-29c6ff80dd11 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:28.234093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-165fd5af-8e4a-48c8-910d-29c6ff80dd11 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.158037 May 13 15:00:28.234663 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 360/688] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:28 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:29.256485 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-09d51b98-b30c-4a34-9ad5-9ca3ae7c8c22 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:29.257631 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-09d51b98-b30c-4a34-9ad5-9ca3ae7c8c22 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:29.265325 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-09d51b98-b30c-4a34-9ad5-9ca3ae7c8c22 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:29.265769 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-09d51b98-b30c-4a34-9ad5-9ca3ae7c8c22 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:29.266546 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-09d51b98-b30c-4a34-9ad5-9ca3ae7c8c22 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:29.266981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-09d51b98-b30c-4a34-9ad5-9ca3ae7c8c22 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:29.410896 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-09d51b98-b30c-4a34-9ad5-9ca3ae7c8c22 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:29.419183 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-09d51b98-b30c-4a34-9ad5-9ca3ae7c8c22 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.169906 May 13 15:00:29.419754 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 329/689] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:29 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:30.438753 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-330a6ac3-af2b-4efe-b9b8-4181f67dc5a7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:30.439455 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-330a6ac3-af2b-4efe-b9b8-4181f67dc5a7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:30.447006 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-330a6ac3-af2b-4efe-b9b8-4181f67dc5a7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:30.447541 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-330a6ac3-af2b-4efe-b9b8-4181f67dc5a7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:30.448502 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-330a6ac3-af2b-4efe-b9b8-4181f67dc5a7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:30.449004 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-330a6ac3-af2b-4efe-b9b8-4181f67dc5a7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:30.582662 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-330a6ac3-af2b-4efe-b9b8-4181f67dc5a7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:30.590638 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-330a6ac3-af2b-4efe-b9b8-4181f67dc5a7 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.156601 May 13 15:00:30.591390 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 361/690] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:30 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:31.608226 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-81a26b3a-1ea1-43e6-a9c5-7dff59fcfa67 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:31.608874 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-81a26b3a-1ea1-43e6-a9c5-7dff59fcfa67 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:31.615533 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-81a26b3a-1ea1-43e6-a9c5-7dff59fcfa67 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:31.616015 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-81a26b3a-1ea1-43e6-a9c5-7dff59fcfa67 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:31.616795 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-81a26b3a-1ea1-43e6-a9c5-7dff59fcfa67 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:31.617223 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-81a26b3a-1ea1-43e6-a9c5-7dff59fcfa67 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:31.757126 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-81a26b3a-1ea1-43e6-a9c5-7dff59fcfa67 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:31.765399 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-81a26b3a-1ea1-43e6-a9c5-7dff59fcfa67 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.162008 May 13 15:00:31.766028 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 330/691] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:31 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:32.782940 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4d88b1d8-7aef-491d-9ed0-b2ef67a03457 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:32.783535 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4d88b1d8-7aef-491d-9ed0-b2ef67a03457 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:32.790228 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4d88b1d8-7aef-491d-9ed0-b2ef67a03457 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:32.790672 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4d88b1d8-7aef-491d-9ed0-b2ef67a03457 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:32.791456 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4d88b1d8-7aef-491d-9ed0-b2ef67a03457 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:32.791896 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4d88b1d8-7aef-491d-9ed0-b2ef67a03457 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:32.930716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4d88b1d8-7aef-491d-9ed0-b2ef67a03457 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:32.944902 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4d88b1d8-7aef-491d-9ed0-b2ef67a03457 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.165815 May 13 15:00:32.945795 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 362/692] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:32 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:33.965768 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-98e09ef6-896f-40e6-beb0-adfe960de07c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:33.966789 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-98e09ef6-896f-40e6-beb0-adfe960de07c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:33.973876 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-98e09ef6-896f-40e6-beb0-adfe960de07c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:33.974319 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-98e09ef6-896f-40e6-beb0-adfe960de07c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:33.975097 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-98e09ef6-896f-40e6-beb0-adfe960de07c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:33.975521 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-98e09ef6-896f-40e6-beb0-adfe960de07c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:34.109974 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-98e09ef6-896f-40e6-beb0-adfe960de07c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:34.118406 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-98e09ef6-896f-40e6-beb0-adfe960de07c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.157401 May 13 15:00:34.119279 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 331/693] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:33 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:34.164454 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-50121683-43c8-4e4f-b9d8-dda40511e2b0 req-0c23c7ab-1f2d-4912-a0e7-643918ff5da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf1ec1b0-5a88-48de-8329-bd0b9792b8d5", "name": "network-vif-plugged", "status": "completed", "tag": "5a1e18eb-74a1-4afa-9947-0dc5d10cc4f0"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:34.173741 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-50121683-43c8-4e4f-b9d8-dda40511e2b0 req-0c23c7ab-1f2d-4912-a0e7-643918ff5da7 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:34.174299 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-50121683-43c8-4e4f-b9d8-dda40511e2b0 req-0c23c7ab-1f2d-4912-a0e7-643918ff5da7 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:34.185575 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-50121683-43c8-4e4f-b9d8-dda40511e2b0 req-0c23c7ab-1f2d-4912-a0e7-643918ff5da7 service nova] Creating event network-vif-plugged:5a1e18eb-74a1-4afa-9947-0dc5d10cc4f0 for instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 on hv-cinder-83090 May 13 15:00:34.190650 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-50121683-43c8-4e4f-b9d8-dda40511e2b0 req-0c23c7ab-1f2d-4912-a0e7-643918ff5da7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092999 May 13 15:00:34.191228 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 363/694] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:00:35.140240 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6ce6aa6c-c0cb-48bc-bc15-8436f05623ec tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:35.140906 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6ce6aa6c-c0cb-48bc-bc15-8436f05623ec tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:35.148445 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6ce6aa6c-c0cb-48bc-bc15-8436f05623ec tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:35.148978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6ce6aa6c-c0cb-48bc-bc15-8436f05623ec tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:35.149831 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6ce6aa6c-c0cb-48bc-bc15-8436f05623ec tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:35.150309 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6ce6aa6c-c0cb-48bc-bc15-8436f05623ec tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:35.294589 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6ce6aa6c-c0cb-48bc-bc15-8436f05623ec tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:35.302988 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6ce6aa6c-c0cb-48bc-bc15-8436f05623ec tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.168901 May 13 15:00:35.303564 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 332/695] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:35 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:35.433180 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d4fe42f3-61d8-4257-90ab-89201a57b1b6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:35.433715 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d4fe42f3-61d8-4257-90ab-89201a57b1b6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:35.440901 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d4fe42f3-61d8-4257-90ab-89201a57b1b6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:35.441355 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d4fe42f3-61d8-4257-90ab-89201a57b1b6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:35.442284 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d4fe42f3-61d8-4257-90ab-89201a57b1b6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:35.442722 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d4fe42f3-61d8-4257-90ab-89201a57b1b6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:35.473522 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d4fe42f3-61d8-4257-90ab-89201a57b1b6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/os-volume_attachments/3a5168c9-b412-4129-8df8-08902fb9d9c9" status: 200 len: 194 microversion: 2.20 time: 0.158237 May 13 15:00:35.474164 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 364/696] 10.222.0.99 () {60 vars in 1453 bytes} [Fri May 13 15:00:35 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/os-volume_attachments/3a5168c9-b412-4129-8df8-08902fb9d9c9 => generated 194 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 15:00:35.544900 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7741eb3a-79e1-4cc2-8372-e4a6c4d3e207 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:35.545429 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7741eb3a-79e1-4cc2-8372-e4a6c4d3e207 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:35.551816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7741eb3a-79e1-4cc2-8372-e4a6c4d3e207 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:35.552345 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7741eb3a-79e1-4cc2-8372-e4a6c4d3e207 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:35.553072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7741eb3a-79e1-4cc2-8372-e4a6c4d3e207 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:35.553529 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7741eb3a-79e1-4cc2-8372-e4a6c4d3e207 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:35.634406 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-7741eb3a-79e1-4cc2-8372-e4a6c4d3e207 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lazy-loading 'services' on Instance uuid 96db69fe-6594-486c-96b3-545e6dbfa29b {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:00:35.715019 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7741eb3a-79e1-4cc2-8372-e4a6c4d3e207 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "DELETE /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/os-volume_attachments/3a5168c9-b412-4129-8df8-08902fb9d9c9" status: 202 len: 0 microversion: 2.20 time: 0.173918 May 13 15:00:35.715664 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 333/697] 10.222.0.99 () {60 vars in 1456 bytes} [Fri May 13 15:00:35 2022] DELETE /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/os-volume_attachments/3a5168c9-b412-4129-8df8-08902fb9d9c9 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 15:00:35.725072 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-cc2d5d15-d654-477c-875e-02f7ebae2437 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:35.726137 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-cc2d5d15-d654-477c-875e-02f7ebae2437 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:35.733263 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cc2d5d15-d654-477c-875e-02f7ebae2437 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:35.733939 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cc2d5d15-d654-477c-875e-02f7ebae2437 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:35.734796 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cc2d5d15-d654-477c-875e-02f7ebae2437 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:35.735270 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cc2d5d15-d654-477c-875e-02f7ebae2437 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:35.767282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-cc2d5d15-d654-477c-875e-02f7ebae2437 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047044 May 13 15:00:35.767861 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 365/698] 10.222.0.99 () {60 vars in 1342 bytes} [Fri May 13 15:00:35 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 15:00:36.326228 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-71e30b70-3b0a-48b3-be7a-1e8c6d25b33e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:36.327302 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-71e30b70-3b0a-48b3-be7a-1e8c6d25b33e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:36.337943 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-71e30b70-3b0a-48b3-be7a-1e8c6d25b33e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:36.338674 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-71e30b70-3b0a-48b3-be7a-1e8c6d25b33e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:36.340050 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-71e30b70-3b0a-48b3-be7a-1e8c6d25b33e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:36.340763 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-71e30b70-3b0a-48b3-be7a-1e8c6d25b33e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:36.480650 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-71e30b70-3b0a-48b3-be7a-1e8c6d25b33e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:36.491998 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-71e30b70-3b0a-48b3-be7a-1e8c6d25b33e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 200 len: 1367 microversion: 2.1 time: 0.173359 May 13 15:00:36.492840 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 334/699] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:36 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:36.783635 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9fb6aa68-a1e0-491f-8583-dc7f3b8996f9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:36.785641 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9fb6aa68-a1e0-491f-8583-dc7f3b8996f9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:36.796291 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9fb6aa68-a1e0-491f-8583-dc7f3b8996f9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:36.796716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9fb6aa68-a1e0-491f-8583-dc7f3b8996f9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:36.797481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9fb6aa68-a1e0-491f-8583-dc7f3b8996f9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:36.797909 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9fb6aa68-a1e0-491f-8583-dc7f3b8996f9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:36.828369 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9fb6aa68-a1e0-491f-8583-dc7f3b8996f9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051700 May 13 15:00:36.828945 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 366/700] 10.222.0.99 () {60 vars in 1342 bytes} [Fri May 13 15:00:36 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 15:00:37.510921 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-24d17fa4-6cd1-4b66-a59c-6024b392a90b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:37.511519 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-24d17fa4-6cd1-4b66-a59c-6024b392a90b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:37.518641 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24d17fa4-6cd1-4b66-a59c-6024b392a90b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:37.519090 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24d17fa4-6cd1-4b66-a59c-6024b392a90b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:37.519854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24d17fa4-6cd1-4b66-a59c-6024b392a90b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:37.520314 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24d17fa4-6cd1-4b66-a59c-6024b392a90b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:37.657278 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-24d17fa4-6cd1-4b66-a59c-6024b392a90b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:37.664727 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-24d17fa4-6cd1-4b66-a59c-6024b392a90b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 200 len: 1557 microversion: 2.1 time: 0.157793 May 13 15:00:37.665305 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 335/701] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:00:37 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:37.681390 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-74d5b9d1-c198-426f-add0-857c0cff3960 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:37.681881 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-74d5b9d1-c198-426f-add0-857c0cff3960 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:37.689686 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-74d5b9d1-c198-426f-add0-857c0cff3960 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:37.690131 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-74d5b9d1-c198-426f-add0-857c0cff3960 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:37.692249 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-74d5b9d1-c198-426f-add0-857c0cff3960 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:37.693000 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-74d5b9d1-c198-426f-add0-857c0cff3960 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:37.781748 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-74d5b9d1-c198-426f-add0-857c0cff3960 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104315 May 13 15:00:37.782327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 367/702] 10.222.0.99 () {58 vars in 1274 bytes} [Fri May 13 15:00:37 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:00:37.840560 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-31fdb3b2-cb4d-43ad-8eae-8dd4e8580cf3 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:37.841598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-31fdb3b2-cb4d-43ad-8eae-8dd4e8580cf3 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:37.847915 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-31fdb3b2-cb4d-43ad-8eae-8dd4e8580cf3 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:37.848363 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-31fdb3b2-cb4d-43ad-8eae-8dd4e8580cf3 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:37.849129 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-31fdb3b2-cb4d-43ad-8eae-8dd4e8580cf3 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:37.849556 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-31fdb3b2-cb4d-43ad-8eae-8dd4e8580cf3 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:37.879516 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-31fdb3b2-cb4d-43ad-8eae-8dd4e8580cf3 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043007 May 13 15:00:37.880100 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 336/703] 10.222.0.99 () {60 vars in 1342 bytes} [Fri May 13 15:00:37 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:00:37.938580 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-a58fe283-1ab6-409e-8af0-022e3215c9c2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:37.939153 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-a58fe283-1ab6-409e-8af0-022e3215c9c2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:37.945335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a58fe283-1ab6-409e-8af0-022e3215c9c2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:37.945856 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a58fe283-1ab6-409e-8af0-022e3215c9c2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:37.946717 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a58fe283-1ab6-409e-8af0-022e3215c9c2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:37.947124 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a58fe283-1ab6-409e-8af0-022e3215c9c2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:37.972025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-a58fe283-1ab6-409e-8af0-022e3215c9c2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Going to try to terminate instance {{(pid=117295) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 15:00:38.052704 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-a58fe283-1ab6-409e-8af0-022e3215c9c2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "DELETE /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 204 len: 0 microversion: 2.20 time: 0.117379 May 13 15:00:38.056111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 368/704] 10.222.0.99 () {60 vars in 1279 bytes} [Fri May 13 15:00:37 2022] DELETE /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 15:00:38.063692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c1886084-b955-4c46-94dc-c237eb8e6112 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:38.064590 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c1886084-b955-4c46-94dc-c237eb8e6112 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:38.071275 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c1886084-b955-4c46-94dc-c237eb8e6112 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:38.072333 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c1886084-b955-4c46-94dc-c237eb8e6112 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:38.073312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c1886084-b955-4c46-94dc-c237eb8e6112 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:38.074095 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c1886084-b955-4c46-94dc-c237eb8e6112 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:38.307025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c1886084-b955-4c46-94dc-c237eb8e6112 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:38.315423 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c1886084-b955-4c46-94dc-c237eb8e6112 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:38.316927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c1886084-b955-4c46-94dc-c237eb8e6112 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:38.318074 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c1886084-b955-4c46-94dc-c237eb8e6112 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.259903 May 13 15:00:38.318644 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 337/705] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:00:38 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:00:39.103657 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-25868b2f-c581-4c81-a8e5-a0ddac057a11 req-d0e54009-841c-4ecf-b760-44dedade72ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf1ec1b0-5a88-48de-8329-bd0b9792b8d5", "tag": "5a1e18eb-74a1-4afa-9947-0dc5d10cc4f0"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:39.113314 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-25868b2f-c581-4c81-a8e5-a0ddac057a11 req-d0e54009-841c-4ecf-b760-44dedade72ff service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:39.113758 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-25868b2f-c581-4c81-a8e5-a0ddac057a11 req-d0e54009-841c-4ecf-b760-44dedade72ff service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:39.126735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-25868b2f-c581-4c81-a8e5-a0ddac057a11 req-d0e54009-841c-4ecf-b760-44dedade72ff service nova] Creating event network-changed:5a1e18eb-74a1-4afa-9947-0dc5d10cc4f0 for instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 on hv-cinder-83090 May 13 15:00:39.131665 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-25868b2f-c581-4c81-a8e5-a0ddac057a11 req-d0e54009-841c-4ecf-b760-44dedade72ff service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032090 May 13 15:00:39.132519 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 369/706] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:00:39.337423 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8f1e757c-94c8-42e5-bc28-a27e9cde7be6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:39.337969 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8f1e757c-94c8-42e5-bc28-a27e9cde7be6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:39.345324 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f1e757c-94c8-42e5-bc28-a27e9cde7be6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:39.345745 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f1e757c-94c8-42e5-bc28-a27e9cde7be6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:39.346520 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f1e757c-94c8-42e5-bc28-a27e9cde7be6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:39.346950 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f1e757c-94c8-42e5-bc28-a27e9cde7be6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:39.478335 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8f1e757c-94c8-42e5-bc28-a27e9cde7be6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:39.487030 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8f1e757c-94c8-42e5-bc28-a27e9cde7be6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:39.488536 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8f1e757c-94c8-42e5-bc28-a27e9cde7be6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:39.489683 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8f1e757c-94c8-42e5-bc28-a27e9cde7be6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.156357 May 13 15:00:39.490215 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 338/707] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:00:39 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:00:40.510394 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9e961a71-701d-4263-9273-53fe7d328267 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:40.511084 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9e961a71-701d-4263-9273-53fe7d328267 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:40.518316 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9e961a71-701d-4263-9273-53fe7d328267 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:40.518768 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9e961a71-701d-4263-9273-53fe7d328267 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:40.519561 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9e961a71-701d-4263-9273-53fe7d328267 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:40.520053 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9e961a71-701d-4263-9273-53fe7d328267 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:40.672447 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9e961a71-701d-4263-9273-53fe7d328267 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:40.680617 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9e961a71-701d-4263-9273-53fe7d328267 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:40.682087 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9e961a71-701d-4263-9273-53fe7d328267 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:40.683345 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9e961a71-701d-4263-9273-53fe7d328267 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1723 microversion: 2.20 time: 0.177969 May 13 15:00:40.683902 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 370/708] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:00:40 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:00:41.389417 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-3db524f7-4b43-4f4f-adc5-dc7d8e73dcb8 req-04463747-a570-4211-a036-4c1e79b1eb29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96db69fe-6594-486c-96b3-545e6dbfa29b", "name": "network-vif-deleted", "tag": "4fd5686b-8efb-4342-9683-06dad26579b5"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:41.399225 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-3db524f7-4b43-4f4f-adc5-dc7d8e73dcb8 req-04463747-a570-4211-a036-4c1e79b1eb29 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:41.399671 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-3db524f7-4b43-4f4f-adc5-dc7d8e73dcb8 req-04463747-a570-4211-a036-4c1e79b1eb29 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:41.411367 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-3db524f7-4b43-4f4f-adc5-dc7d8e73dcb8 req-04463747-a570-4211-a036-4c1e79b1eb29 service nova] Creating event network-vif-deleted:4fd5686b-8efb-4342-9683-06dad26579b5 for instance 96db69fe-6594-486c-96b3-545e6dbfa29b on hv-cinder-83090 May 13 15:00:41.416366 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-3db524f7-4b43-4f4f-adc5-dc7d8e73dcb8 req-04463747-a570-4211-a036-4c1e79b1eb29 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030723 May 13 15:00:41.417123 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 339/709] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:00:41.702810 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-83d094f2-e53a-413a-826f-45ee669cba0f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:41.703350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-83d094f2-e53a-413a-826f-45ee669cba0f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:41.713042 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-83d094f2-e53a-413a-826f-45ee669cba0f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:41.713819 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-83d094f2-e53a-413a-826f-45ee669cba0f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:41.714991 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-83d094f2-e53a-413a-826f-45ee669cba0f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:41.715580 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-83d094f2-e53a-413a-826f-45ee669cba0f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:41.747197 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-83d094f2-e53a-413a-826f-45ee669cba0f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:41.747645 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-83d094f2-e53a-413a-826f-45ee669cba0f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:41.748116 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-83d094f2-e53a-413a-826f-45ee669cba0f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lazy-loading 'fault' on Instance uuid 96db69fe-6594-486c-96b3-545e6dbfa29b {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:00:41.789976 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-83d094f2-e53a-413a-826f-45ee669cba0f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:41.798399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-83d094f2-e53a-413a-826f-45ee669cba0f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:41.799893 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-83d094f2-e53a-413a-826f-45ee669cba0f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:41.801087 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-83d094f2-e53a-413a-826f-45ee669cba0f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 200 len: 1370 microversion: 2.20 time: 0.102575 May 13 15:00:41.801628 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 371/710] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:00:41 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 1370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:00:42.825221 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-85af6309-095c-4938-ba89-79bce4cc7ee4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:42.826381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-85af6309-095c-4938-ba89-79bce4cc7ee4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:42.833759 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-85af6309-095c-4938-ba89-79bce4cc7ee4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:42.834210 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-85af6309-095c-4938-ba89-79bce4cc7ee4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:42.834978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-85af6309-095c-4938-ba89-79bce4cc7ee4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:42.835409 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-85af6309-095c-4938-ba89-79bce4cc7ee4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:42.848974 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-85af6309-095c-4938-ba89-79bce4cc7ee4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] HTTP exception thrown: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-85af6309-095c-4938-ba89-79bce4cc7ee4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Request method failure captured: May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b HTTP/1.1 May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnEQgrlA5i3R7SWL6crQlDizwHkqb-2xI3k7Lm_nlzjadbOU3BuFdsGTw2elv2hA2YFDWCs1lC0SC6X-QGRQictZidoiM7h6N_gG5jMk3ZLXUbcBTsRYon4xnYTaQvI72l612hToEehW4wF0oZwcsCC7fXFuLQ9FBQ2ZdW9HPs2vG4M May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Openstack-Nova-Api-Version: 2.20 May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 9d31191dfc694e3b94a6139dd2e9653f May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:00:42.850598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:00:42.852327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9d31191dfc694e3b94a6139dd2e9653f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:00:42.852327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:00:42.852327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 9d31191dfc694e3b94a6139dd2e9653f May 13 15:00:42.852327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:00:42.852327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-AttachVolumeShelveTestJSON-1242529642-project May 13 15:00:42.852327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:00:42.852327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:00:42.852327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: ac89928ac188406d910838be33a61c3e May 13 15:00:42.852327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1242529642-project May 13 15:00:42.852327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 15:00:42.852327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. May 13 15:00:42.852327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': '96db69fe-6594-486c-96b3-545e6dbfa29b'} May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:00:42.856523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. May 13 15:00:42.857952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:00:42.859283 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-85af6309-095c-4938-ba89-79bce4cc7ee4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Returning 404 to user: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:00:42.859283 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-85af6309-095c-4938-ba89-79bce4cc7ee4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 404 len: 111 microversion: 2.20 time: 0.034611 May 13 15:00:42.859283 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 340/711] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:00:42 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 15:00:42.861742 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-64b644f8-5756-4ab7-9921-24cf21e221a6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '.version_select at 0x7fcf4ca9daf0>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:42.882611 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-64b644f8-5756-4ab7-9921-24cf21e221a6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-453477896" status: 204 len: 0 microversion: 2.20 time: 0.025039 May 13 15:00:42.883185 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 372/712] 10.222.0.99 () {60 vars in 1258 bytes} [Fri May 13 15:00:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-453477896 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 15:00:43.559764 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7e2c0183-7355-4f0d-adf6-d6f5f6e7ba4e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Action: 'create', calling method: .version_select at 0x7fcf48032280>, body: {"keypair": {"name": "tempest-keypair-845874534", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjEajcscG9bOstNp+/a/VUIOLdLvrrAIH0bgXKkWfBH/QERToP9i/8F63/6WPzWCNmIrLed4/N9JTbTnhaFwdla8Bmgc9AUYkiCp+C/7HNJg6ia7cu6Z2esky88SKcEww=="}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:43.579127 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-7e2c0183-7355-4f0d-adf6-d6f5f6e7ba4e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Getting quotas for project 9d31191dfc694e3b94a6139dd2e9653f. Resources: {'key_pairs'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 15:00:43.583047 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-7e2c0183-7355-4f0d-adf6-d6f5f6e7ba4e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Getting quotas for user ac89928ac188406d910838be33a61c3e and project 9d31191dfc694e3b94a6139dd2e9653f. Resources: {'key_pairs'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 15:00:43.610277 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7e2c0183-7355-4f0d-adf6-d6f5f6e7ba4e tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.054446 May 13 15:00:43.610901 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 341/713] 10.222.0.99 () {62 vars in 1199 bytes} [Fri May 13 15:00:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 13 15:00:45.130973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-bd439e93-5f8e-42bf-9f7e-8e4bf0c41d42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1291832756", "imageRef": "eac0bc7b-d963-4624-aba3-a81fd1bf324c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c888f077-916d-48b7-a870-8fa454d08ec4"}], "security_groups": [{"name": "tempest-securitygroup--1412634842"}], "key_name": "tempest-keypair-845874534", "user_data": "}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:45.245381 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.network.neutron [None req-bd439e93-5f8e-42bf-9f7e-8e4bf0c41d42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] validate_networks() for [('c888f077-916d-48b7-a870-8fa454d08ec4', None, None, None, None, None)] {{(pid=117295) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 15:00:45.699345 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-bd439e93-5f8e-42bf-9f7e-8e4bf0c41d42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Flavor limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 15:00:45.699917 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-bd439e93-5f8e-42bf-9f7e-8e4bf0c41d42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Image limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 15:00:45.700653 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-bd439e93-5f8e-42bf-9f7e-8e4bf0c41d42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Flavor pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 15:00:45.701217 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-bd439e93-5f8e-42bf-9f7e-8e4bf0c41d42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Image pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 15:00:45.701856 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-bd439e93-5f8e-42bf-9f7e-8e4bf0c41d42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 15:00:45.712310 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bd439e93-5f8e-42bf-9f7e-8e4bf0c41d42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:45.712760 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bd439e93-5f8e-42bf-9f7e-8e4bf0c41d42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:45.713600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bd439e93-5f8e-42bf-9f7e-8e4bf0c41d42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:45.714037 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bd439e93-5f8e-42bf-9f7e-8e4bf0c41d42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:45.730893 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-bd439e93-5f8e-42bf-9f7e-8e4bf0c41d42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Getting quotas for project 9d31191dfc694e3b94a6139dd2e9653f. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 15:00:45.735485 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-bd439e93-5f8e-42bf-9f7e-8e4bf0c41d42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Getting quotas for user ac89928ac188406d910838be33a61c3e and project 9d31191dfc694e3b94a6139dd2e9653f. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 15:00:45.747403 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-bd439e93-5f8e-42bf-9f7e-8e4bf0c41d42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Going to run 1 instances... {{(pid=117295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 15:00:45.750154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-bd439e93-5f8e-42bf-9f7e-8e4bf0c41d42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac0bc7b-d963-4624-aba3-a81fd1bf324c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 15:00:45.799364 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-bd439e93-5f8e-42bf-9f7e-8e4bf0c41d42 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.673357 May 13 15:00:45.800238 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 373/714] 10.222.0.99 () {62 vars in 1187 bytes} [Fri May 13 15:00:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 13 15:00:45.810357 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f9c93fc9-9703-423d-a8cc-daec0804fe1c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:45.810945 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f9c93fc9-9703-423d-a8cc-daec0804fe1c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:45.870103 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f9c93fc9-9703-423d-a8cc-daec0804fe1c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:45.877865 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f9c93fc9-9703-423d-a8cc-daec0804fe1c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:45.879352 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f9c93fc9-9703-423d-a8cc-daec0804fe1c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:45.880591 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f9c93fc9-9703-423d-a8cc-daec0804fe1c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1281 microversion: 2.20 time: 0.074232 May 13 15:00:45.881279 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 342/715] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:00:45 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:00:46.903009 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d5867782-1087-43ae-ae7a-ba8b81d3ce28 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:46.904202 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d5867782-1087-43ae-ae7a-ba8b81d3ce28 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:46.918260 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d5867782-1087-43ae-ae7a-ba8b81d3ce28 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:46.918712 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d5867782-1087-43ae-ae7a-ba8b81d3ce28 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:46.919686 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d5867782-1087-43ae-ae7a-ba8b81d3ce28 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:46.920239 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d5867782-1087-43ae-ae7a-ba8b81d3ce28 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:46.992720 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d5867782-1087-43ae-ae7a-ba8b81d3ce28 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:47.001984 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d5867782-1087-43ae-ae7a-ba8b81d3ce28 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:47.003406 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d5867782-1087-43ae-ae7a-ba8b81d3ce28 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:47.004577 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d5867782-1087-43ae-ae7a-ba8b81d3ce28 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1341 microversion: 2.20 time: 0.108045 May 13 15:00:47.005324 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 374/716] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:00:46 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1341 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:00:48.023032 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-d6513d9a-53e3-4a47-8930-684eafe5dce9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:48.023588 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-d6513d9a-53e3-4a47-8930-684eafe5dce9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:48.030844 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d6513d9a-53e3-4a47-8930-684eafe5dce9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:48.031475 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d6513d9a-53e3-4a47-8930-684eafe5dce9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:48.032287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d6513d9a-53e3-4a47-8930-684eafe5dce9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:48.032774 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d6513d9a-53e3-4a47-8930-684eafe5dce9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:48.162111 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-d6513d9a-53e3-4a47-8930-684eafe5dce9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:48.170196 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-d6513d9a-53e3-4a47-8930-684eafe5dce9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:48.171790 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-d6513d9a-53e3-4a47-8930-684eafe5dce9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:48.173287 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-d6513d9a-53e3-4a47-8930-684eafe5dce9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1407 microversion: 2.20 time: 0.154268 May 13 15:00:48.181681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 343/717] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:00:48 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:00:48.500496 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-f8a9117e-7112-4033-8a5c-df53b7c4f59a req-db7d7686-c7ce-4a42-9739-1eca1ef25abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d326e41-aedb-47b1-bf2f-e7784d3d4894", "tag": "31bf981e-aa80-4a0b-a642-84d2bded56aa"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:48.525627 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-f8a9117e-7112-4033-8a5c-df53b7c4f59a req-db7d7686-c7ce-4a42-9739-1eca1ef25abf service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:48.526050 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-f8a9117e-7112-4033-8a5c-df53b7c4f59a req-db7d7686-c7ce-4a42-9739-1eca1ef25abf service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:48.541582 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-f8a9117e-7112-4033-8a5c-df53b7c4f59a req-db7d7686-c7ce-4a42-9739-1eca1ef25abf service nova] Creating event network-changed:31bf981e-aa80-4a0b-a642-84d2bded56aa for instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 on hv-cinder-83090 May 13 15:00:48.546963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-f8a9117e-7112-4033-8a5c-df53b7c4f59a req-db7d7686-c7ce-4a42-9739-1eca1ef25abf service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056915 May 13 15:00:48.548239 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 375/718] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:00:49.194752 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-300d91fa-31ad-429f-be9c-da4ae3ae7c70 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:49.195491 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-300d91fa-31ad-429f-be9c-da4ae3ae7c70 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:49.205844 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-300d91fa-31ad-429f-be9c-da4ae3ae7c70 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:49.205844 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-300d91fa-31ad-429f-be9c-da4ae3ae7c70 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:49.206485 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-300d91fa-31ad-429f-be9c-da4ae3ae7c70 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:49.207071 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-300d91fa-31ad-429f-be9c-da4ae3ae7c70 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:49.348054 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-300d91fa-31ad-429f-be9c-da4ae3ae7c70 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:49.356296 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-300d91fa-31ad-429f-be9c-da4ae3ae7c70 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:49.357790 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-300d91fa-31ad-429f-be9c-da4ae3ae7c70 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:49.358903 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-300d91fa-31ad-429f-be9c-da4ae3ae7c70 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1407 microversion: 2.20 time: 0.170595 May 13 15:00:49.359466 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 344/719] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:00:49 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:00:50.377705 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-28bf4db5-ef84-44f9-b596-05cf98dd4027 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:50.378412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-28bf4db5-ef84-44f9-b596-05cf98dd4027 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:50.385415 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-28bf4db5-ef84-44f9-b596-05cf98dd4027 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:50.385867 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-28bf4db5-ef84-44f9-b596-05cf98dd4027 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:50.386644 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-28bf4db5-ef84-44f9-b596-05cf98dd4027 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:50.387085 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-28bf4db5-ef84-44f9-b596-05cf98dd4027 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:50.527932 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-28bf4db5-ef84-44f9-b596-05cf98dd4027 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:50.536246 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-28bf4db5-ef84-44f9-b596-05cf98dd4027 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:50.537728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-28bf4db5-ef84-44f9-b596-05cf98dd4027 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:50.538833 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-28bf4db5-ef84-44f9-b596-05cf98dd4027 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1407 microversion: 2.20 time: 0.166034 May 13 15:00:50.539401 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 376/720] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:00:50 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:00:51.557396 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b586d187-c55e-44cd-bbea-4df625af3d62 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:51.557989 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b586d187-c55e-44cd-bbea-4df625af3d62 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:51.564797 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b586d187-c55e-44cd-bbea-4df625af3d62 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:51.565247 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b586d187-c55e-44cd-bbea-4df625af3d62 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:51.565994 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b586d187-c55e-44cd-bbea-4df625af3d62 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:51.566455 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b586d187-c55e-44cd-bbea-4df625af3d62 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:51.704105 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b586d187-c55e-44cd-bbea-4df625af3d62 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:51.712658 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b586d187-c55e-44cd-bbea-4df625af3d62 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:51.714129 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b586d187-c55e-44cd-bbea-4df625af3d62 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:51.715229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b586d187-c55e-44cd-bbea-4df625af3d62 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1407 microversion: 2.20 time: 0.161954 May 13 15:00:51.715818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 345/721] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:00:51 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:00:52.734244 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-73652dbd-74e9-400f-8171-764a4b0a4e5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:52.734867 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-73652dbd-74e9-400f-8171-764a4b0a4e5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:52.745907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-73652dbd-74e9-400f-8171-764a4b0a4e5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:52.746652 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-73652dbd-74e9-400f-8171-764a4b0a4e5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:52.747940 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-73652dbd-74e9-400f-8171-764a4b0a4e5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:52.748714 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-73652dbd-74e9-400f-8171-764a4b0a4e5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:52.888711 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-73652dbd-74e9-400f-8171-764a4b0a4e5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:52.900836 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-73652dbd-74e9-400f-8171-764a4b0a4e5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:52.903137 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-73652dbd-74e9-400f-8171-764a4b0a4e5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:52.904825 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-73652dbd-74e9-400f-8171-764a4b0a4e5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1407 microversion: 2.20 time: 0.174969 May 13 15:00:52.905700 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 377/722] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:00:52 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:00:53.928343 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-529f069b-5246-4637-88ee-c4e013221185 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:53.928957 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-529f069b-5246-4637-88ee-c4e013221185 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:53.936823 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-529f069b-5246-4637-88ee-c4e013221185 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:53.937343 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-529f069b-5246-4637-88ee-c4e013221185 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:53.938231 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-529f069b-5246-4637-88ee-c4e013221185 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:53.938730 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-529f069b-5246-4637-88ee-c4e013221185 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:54.078024 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-529f069b-5246-4637-88ee-c4e013221185 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:54.085959 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-529f069b-5246-4637-88ee-c4e013221185 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:54.087437 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-529f069b-5246-4637-88ee-c4e013221185 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:54.088578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-529f069b-5246-4637-88ee-c4e013221185 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1407 microversion: 2.20 time: 0.166330 May 13 15:00:54.089147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 346/723] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:00:53 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:00:54.186118 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-8ba44b45-086f-4f03-af6d-5d9691e3001a req-0ee61cc4-ca55-4fa0-bd27-bb4ebb81d82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d326e41-aedb-47b1-bf2f-e7784d3d4894", "name": "network-vif-plugged", "status": "completed", "tag": "31bf981e-aa80-4a0b-a642-84d2bded56aa"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:54.194720 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-8ba44b45-086f-4f03-af6d-5d9691e3001a req-0ee61cc4-ca55-4fa0-bd27-bb4ebb81d82d service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:54.195192 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-8ba44b45-086f-4f03-af6d-5d9691e3001a req-0ee61cc4-ca55-4fa0-bd27-bb4ebb81d82d service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:54.206276 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-8ba44b45-086f-4f03-af6d-5d9691e3001a req-0ee61cc4-ca55-4fa0-bd27-bb4ebb81d82d service nova] Creating event network-vif-plugged:31bf981e-aa80-4a0b-a642-84d2bded56aa for instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 on hv-cinder-83090 May 13 15:00:54.211301 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-8ba44b45-086f-4f03-af6d-5d9691e3001a req-0ee61cc4-ca55-4fa0-bd27-bb4ebb81d82d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028882 May 13 15:00:54.211966 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 378/724] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:00:55.107239 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5827532a-6a30-4ac1-89a9-88d4303f7a95 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:55.107858 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5827532a-6a30-4ac1-89a9-88d4303f7a95 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:55.115118 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5827532a-6a30-4ac1-89a9-88d4303f7a95 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:55.115568 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5827532a-6a30-4ac1-89a9-88d4303f7a95 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:55.116378 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5827532a-6a30-4ac1-89a9-88d4303f7a95 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:55.116817 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5827532a-6a30-4ac1-89a9-88d4303f7a95 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:55.269968 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5827532a-6a30-4ac1-89a9-88d4303f7a95 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:55.278054 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5827532a-6a30-4ac1-89a9-88d4303f7a95 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:55.279516 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5827532a-6a30-4ac1-89a9-88d4303f7a95 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:55.280637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5827532a-6a30-4ac1-89a9-88d4303f7a95 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1407 microversion: 2.20 time: 0.177768 May 13 15:00:55.281169 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 347/725] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:00:55 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:00:56.309424 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-b3902451-1280-4da8-955a-0f90972d085f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:56.310076 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-b3902451-1280-4da8-955a-0f90972d085f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:56.318923 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b3902451-1280-4da8-955a-0f90972d085f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:56.319369 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b3902451-1280-4da8-955a-0f90972d085f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:56.320204 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b3902451-1280-4da8-955a-0f90972d085f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:56.320637 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b3902451-1280-4da8-955a-0f90972d085f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:56.450296 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b3902451-1280-4da8-955a-0f90972d085f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:56.458379 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b3902451-1280-4da8-955a-0f90972d085f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:56.459860 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b3902451-1280-4da8-955a-0f90972d085f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:00:56.461050 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-b3902451-1280-4da8-955a-0f90972d085f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1599 microversion: 2.20 time: 0.158978 May 13 15:00:56.461593 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 379/726] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:00:56 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 15:00:56.478778 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b4a11610-d58d-4081-bd9c-aafe2d505b11 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:00:56.479300 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b4a11610-d58d-4081-bd9c-aafe2d505b11 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:00:56.486249 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b4a11610-d58d-4081-bd9c-aafe2d505b11 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:56.486703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b4a11610-d58d-4081-bd9c-aafe2d505b11 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:56.487507 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b4a11610-d58d-4081-bd9c-aafe2d505b11 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:56.488522 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b4a11610-d58d-4081-bd9c-aafe2d505b11 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:56.567460 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b4a11610-d58d-4081-bd9c-aafe2d505b11 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092581 May 13 15:00:56.568099 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 348/727] 10.222.0.99 () {60 vars in 1315 bytes} [Fri May 13 15:00:56 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 15:00:57.589158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-ab173353-d924-44be-bc08-9ac9e82f2f76 req-58a8e3fd-2ff6-4bc9-8442-51f158928786 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d326e41-aedb-47b1-bf2f-e7784d3d4894", "tag": "31bf981e-aa80-4a0b-a642-84d2bded56aa"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:00:57.598177 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-ab173353-d924-44be-bc08-9ac9e82f2f76 req-58a8e3fd-2ff6-4bc9-8442-51f158928786 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:00:57.598554 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-ab173353-d924-44be-bc08-9ac9e82f2f76 req-58a8e3fd-2ff6-4bc9-8442-51f158928786 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:00:57.609859 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-ab173353-d924-44be-bc08-9ac9e82f2f76 req-58a8e3fd-2ff6-4bc9-8442-51f158928786 service nova] Creating event network-changed:31bf981e-aa80-4a0b-a642-84d2bded56aa for instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 on hv-cinder-83090 May 13 15:00:57.615402 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-ab173353-d924-44be-bc08-9ac9e82f2f76 req-58a8e3fd-2ff6-4bc9-8442-51f158928786 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030747 May 13 15:00:57.616032 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 380/728] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:01:13.136037 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-198014ca-a87d-476c-bd85-1048313ca62b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:13.136786 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-198014ca-a87d-476c-bd85-1048313ca62b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:13.143095 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-198014ca-a87d-476c-bd85-1048313ca62b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:13.143536 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-198014ca-a87d-476c-bd85-1048313ca62b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:13.144334 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-198014ca-a87d-476c-bd85-1048313ca62b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:13.144734 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-198014ca-a87d-476c-bd85-1048313ca62b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:13.241486 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-198014ca-a87d-476c-bd85-1048313ca62b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lazy-loading 'services' on Instance uuid 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:01:13.321433 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-198014ca-a87d-476c-bd85-1048313ca62b tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "DELETE /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/os-volume_attachments/bcf58ff9-7710-46c9-98a2-59b1032eeb67" status: 202 len: 0 microversion: 2.1 time: 0.189762 May 13 15:01:13.322292 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 349/729] 10.222.0.99 () {58 vars in 1415 bytes} [Fri May 13 15:01:13 2022] DELETE /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/os-volume_attachments/bcf58ff9-7710-46c9-98a2-59b1032eeb67 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:01:13.332716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-8cbbd9ab-d7bd-484d-9446-cf7b95ad668d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:13.333653 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-8cbbd9ab-d7bd-484d-9446-cf7b95ad668d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:13.340512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8cbbd9ab-d7bd-484d-9446-cf7b95ad668d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:13.341026 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8cbbd9ab-d7bd-484d-9446-cf7b95ad668d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:13.341927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8cbbd9ab-d7bd-484d-9446-cf7b95ad668d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:13.342371 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8cbbd9ab-d7bd-484d-9446-cf7b95ad668d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:13.376584 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-8cbbd9ab-d7bd-484d-9446-cf7b95ad668d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049500 May 13 15:01:13.377137 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 381/730] 10.222.0.99 () {58 vars in 1301 bytes} [Fri May 13 15:01:13 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:01:14.393301 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5603eb6b-2b29-45a7-9735-101f5c1c3aae tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:14.394646 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5603eb6b-2b29-45a7-9735-101f5c1c3aae tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:14.401773 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5603eb6b-2b29-45a7-9735-101f5c1c3aae tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:14.402217 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5603eb6b-2b29-45a7-9735-101f5c1c3aae tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:14.403096 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5603eb6b-2b29-45a7-9735-101f5c1c3aae tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:14.403443 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5603eb6b-2b29-45a7-9735-101f5c1c3aae tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:14.435902 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5603eb6b-2b29-45a7-9735-101f5c1c3aae tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050348 May 13 15:01:14.436465 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 350/731] 10.222.0.99 () {58 vars in 1301 bytes} [Fri May 13 15:01:14 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 15:01:14.519267 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d56bee9e-4722-4986-bfe6-b02048610bcb tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:14.519772 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d56bee9e-4722-4986-bfe6-b02048610bcb tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:14.526389 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d56bee9e-4722-4986-bfe6-b02048610bcb tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:14.526836 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d56bee9e-4722-4986-bfe6-b02048610bcb tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:14.527606 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d56bee9e-4722-4986-bfe6-b02048610bcb tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:14.528080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d56bee9e-4722-4986-bfe6-b02048610bcb tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:14.552962 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d56bee9e-4722-4986-bfe6-b02048610bcb tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Going to try to terminate instance {{(pid=117295) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 15:01:14.640812 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d56bee9e-4722-4986-bfe6-b02048610bcb tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "DELETE /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 204 len: 0 microversion: 2.1 time: 0.124637 May 13 15:01:14.642069 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 382/732] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:01:14 2022] DELETE /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 15:01:14.650139 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-335a40cf-bf46-435d-b506-459c5768c8df tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:14.650747 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-335a40cf-bf46-435d-b506-459c5768c8df tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:14.656948 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-335a40cf-bf46-435d-b506-459c5768c8df tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:14.657486 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-335a40cf-bf46-435d-b506-459c5768c8df tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:14.658258 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-335a40cf-bf46-435d-b506-459c5768c8df tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:14.658697 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-335a40cf-bf46-435d-b506-459c5768c8df tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:14.795054 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-335a40cf-bf46-435d-b506-459c5768c8df tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:14.807350 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-335a40cf-bf46-435d-b506-459c5768c8df tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1690 microversion: 2.1 time: 0.160782 May 13 15:01:14.808239 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 351/733] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:14 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:15.832808 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f62a2956-d121-4ed8-ac17-954a3defa404 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:15.833366 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f62a2956-d121-4ed8-ac17-954a3defa404 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:15.841328 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f62a2956-d121-4ed8-ac17-954a3defa404 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:15.841820 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f62a2956-d121-4ed8-ac17-954a3defa404 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:15.842904 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f62a2956-d121-4ed8-ac17-954a3defa404 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:15.843588 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f62a2956-d121-4ed8-ac17-954a3defa404 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:15.986681 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f62a2956-d121-4ed8-ac17-954a3defa404 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:15.997316 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f62a2956-d121-4ed8-ac17-954a3defa404 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1690 microversion: 2.1 time: 0.172550 May 13 15:01:15.998004 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 383/734] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:15 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:17.019535 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-74455907-e349-476a-83a4-3be89da7b3ff tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:17.022499 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-74455907-e349-476a-83a4-3be89da7b3ff tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:17.026768 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-74455907-e349-476a-83a4-3be89da7b3ff tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:17.027209 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-74455907-e349-476a-83a4-3be89da7b3ff tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:17.027994 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-74455907-e349-476a-83a4-3be89da7b3ff tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:17.028422 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-74455907-e349-476a-83a4-3be89da7b3ff tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:17.182660 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-74455907-e349-476a-83a4-3be89da7b3ff tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:17.193448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-74455907-e349-476a-83a4-3be89da7b3ff tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1690 microversion: 2.1 time: 0.177991 May 13 15:01:17.194023 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 352/735] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:17 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:18.214673 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-cafb9d5c-3da2-4cb9-92f3-5b4a5fcb5b79 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:18.215816 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-cafb9d5c-3da2-4cb9-92f3-5b4a5fcb5b79 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:18.227386 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cafb9d5c-3da2-4cb9-92f3-5b4a5fcb5b79 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:18.228204 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cafb9d5c-3da2-4cb9-92f3-5b4a5fcb5b79 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:18.229869 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cafb9d5c-3da2-4cb9-92f3-5b4a5fcb5b79 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:18.230585 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cafb9d5c-3da2-4cb9-92f3-5b4a5fcb5b79 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:18.374954 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-cafb9d5c-3da2-4cb9-92f3-5b4a5fcb5b79 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:18.382803 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-cafb9d5c-3da2-4cb9-92f3-5b4a5fcb5b79 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1690 microversion: 2.1 time: 0.174687 May 13 15:01:18.383421 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 384/736] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:18 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:19.401914 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-09f455db-1ea3-4a5f-9d86-92c2259c871d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:19.402699 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-09f455db-1ea3-4a5f-9d86-92c2259c871d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:19.410134 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-09f455db-1ea3-4a5f-9d86-92c2259c871d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:19.410581 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-09f455db-1ea3-4a5f-9d86-92c2259c871d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:19.411364 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-09f455db-1ea3-4a5f-9d86-92c2259c871d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:19.411792 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-09f455db-1ea3-4a5f-9d86-92c2259c871d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:19.554118 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-09f455db-1ea3-4a5f-9d86-92c2259c871d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:19.562304 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-09f455db-1ea3-4a5f-9d86-92c2259c871d tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1690 microversion: 2.1 time: 0.164324 May 13 15:01:19.563043 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 353/737] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:19 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:20.017990 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-5619a3d2-4069-4ab3-a3af-86939d7645f9 req-4f2d9ab9-f9a6-4c8b-9b2f-3ca89eea6853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15fd606f-6ebc-46d6-9fe8-bd7219c22f27", "name": "network-vif-deleted", "tag": "751bef1d-e5f5-41a9-bbf3-44c2a5dc804c"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:01:20.030490 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-5619a3d2-4069-4ab3-a3af-86939d7645f9 req-4f2d9ab9-f9a6-4c8b-9b2f-3ca89eea6853 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:20.030927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-5619a3d2-4069-4ab3-a3af-86939d7645f9 req-4f2d9ab9-f9a6-4c8b-9b2f-3ca89eea6853 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:20.043812 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-5619a3d2-4069-4ab3-a3af-86939d7645f9 req-4f2d9ab9-f9a6-4c8b-9b2f-3ca89eea6853 service nova] Creating event network-vif-deleted:751bef1d-e5f5-41a9-bbf3-44c2a5dc804c for instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 on hv-cinder-83090 May 13 15:01:20.062375 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-5619a3d2-4069-4ab3-a3af-86939d7645f9 req-4f2d9ab9-f9a6-4c8b-9b2f-3ca89eea6853 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047727 May 13 15:01:20.064004 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 385/738] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:01:20.579576 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-67a174b7-d8c0-4634-be91-597e9b28aa17 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:20.580202 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-67a174b7-d8c0-4634-be91-597e9b28aa17 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:20.586955 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-67a174b7-d8c0-4634-be91-597e9b28aa17 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:20.587368 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-67a174b7-d8c0-4634-be91-597e9b28aa17 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:20.588435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-67a174b7-d8c0-4634-be91-597e9b28aa17 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:20.588980 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-67a174b7-d8c0-4634-be91-597e9b28aa17 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:20.620529 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-67a174b7-d8c0-4634-be91-597e9b28aa17 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:20.621069 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-67a174b7-d8c0-4634-be91-597e9b28aa17 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:20.621651 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-67a174b7-d8c0-4634-be91-597e9b28aa17 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lazy-loading 'fault' on Instance uuid 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:01:20.667674 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-67a174b7-d8c0-4634-be91-597e9b28aa17 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:20.674899 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-67a174b7-d8c0-4634-be91-597e9b28aa17 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 200 len: 1334 microversion: 2.1 time: 0.099205 May 13 15:01:20.675550 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 354/739] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:20 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 1334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:21.694346 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-bab0d64a-078d-456b-b4cb-1a57583f82d8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:21.695156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-bab0d64a-078d-456b-b4cb-1a57583f82d8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 15fd606f-6ebc-46d6-9fe8-bd7219c22f27] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:21.703373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bab0d64a-078d-456b-b4cb-1a57583f82d8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:21.703673 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bab0d64a-078d-456b-b4cb-1a57583f82d8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:21.704612 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bab0d64a-078d-456b-b4cb-1a57583f82d8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:21.705114 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bab0d64a-078d-456b-b4cb-1a57583f82d8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:21.721523 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-bab0d64a-078d-456b-b4cb-1a57583f82d8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] HTTP exception thrown: Instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 could not be found. May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-bab0d64a-078d-456b-b4cb-1a57583f82d8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Request method failure captured: May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 HTTP/1.1 May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnEX_YCathXpRmMcmTHQK870dglSF1vIXxzMt9X_shkAAeZwK4OTEv8qG1yD9PbTZPRObjiSCwpvBFNAjyx-LTvGwuXfzsCenvc4jAiGwqb8FMR9nOVYkdImh9s_ciWTDSnHjkxjTZz4HRMjY3xYhYqIBKRc16CgA1qR8RAGN_F-tSg May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 55a6554838094ba8a8b807bd90ec5bf4 May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-427117176 May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:01:21.723163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:01:21.724804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a6554838094ba8a8b807bd90ec5bf4", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a6554838094ba8a8b807bd90ec5bf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a6554838094ba8a8b807bd90ec5bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a6554838094ba8a8b807bd90ec5bf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:01:21.724804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-ServerRescueNegativeTestJSON-427117176 May 13 15:01:21.724804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 55a6554838094ba8a8b807bd90ec5bf4 May 13 15:01:21.724804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-427117176 May 13 15:01:21.724804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-ServerRescueNegativeTestJSON-427117176-project May 13 15:01:21.724804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:01:21.724804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:01:21.724804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 18907451ac014573ba51f5f5f3939381 May 13 15:01:21.724804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-ServerRescueNegativeTestJSON-427117176-project May 13 15:01:21.724804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:01:21.724804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 could not be found. May 13 15:01:21.724804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '15fd606f-6ebc-46d6-9fe8-bd7219c22f27'} May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 could not be found. May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:01:21.725974 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 could not be found. May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 could not be found. May 13 15:01:21.728323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:01:21.730742 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-bab0d64a-078d-456b-b4cb-1a57583f82d8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Returning 404 to user: Instance 15fd606f-6ebc-46d6-9fe8-bd7219c22f27 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:01:21.730742 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-bab0d64a-078d-456b-b4cb-1a57583f82d8 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27" status: 404 len: 111 microversion: 2.1 time: 0.035208 May 13 15:01:21.730742 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 386/740] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:21 2022] GET /compute/v2.1/servers/15fd606f-6ebc-46d6-9fe8-bd7219c22f27 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:01:21.735624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9cabf42f-f6e3-4593-8292-365ecf2af70c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '.version_select at 0x7fcf480321f0>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:21.756691 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9cabf42f-f6e3-4593-8292-365ecf2af70c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-679290579" status: 202 len: 0 microversion: 2.1 time: 0.024982 May 13 15:01:21.757249 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 355/741] 10.222.0.99 () {58 vars in 1217 bytes} [Fri May 13 15:01:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-679290579 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:01:24.663058 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-999b18fb-2f2e-413f-93a6-91714c8f9c60 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:24.663563 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-999b18fb-2f2e-413f-93a6-91714c8f9c60 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:24.670323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-999b18fb-2f2e-413f-93a6-91714c8f9c60 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:24.670752 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-999b18fb-2f2e-413f-93a6-91714c8f9c60 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:24.671530 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-999b18fb-2f2e-413f-93a6-91714c8f9c60 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:24.672001 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-999b18fb-2f2e-413f-93a6-91714c8f9c60 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:24.697674 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-999b18fb-2f2e-413f-93a6-91714c8f9c60 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Going to try to terminate instance {{(pid=117295) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 15:01:24.780689 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-999b18fb-2f2e-413f-93a6-91714c8f9c60 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "DELETE /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 204 len: 0 microversion: 2.1 time: 0.121174 May 13 15:01:24.781329 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 387/742] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:01:24 2022] DELETE /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 15:01:24.790299 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-03fb4130-4c10-48bc-afca-412dcbeb693c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:24.790912 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-03fb4130-4c10-48bc-afca-412dcbeb693c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:24.797449 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-03fb4130-4c10-48bc-afca-412dcbeb693c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:24.799206 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-03fb4130-4c10-48bc-afca-412dcbeb693c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:24.799206 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-03fb4130-4c10-48bc-afca-412dcbeb693c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:24.799206 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-03fb4130-4c10-48bc-afca-412dcbeb693c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:24.953092 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-03fb4130-4c10-48bc-afca-412dcbeb693c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:24.961202 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-03fb4130-4c10-48bc-afca-412dcbeb693c tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1508 microversion: 2.1 time: 0.175364 May 13 15:01:24.961743 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 356/743] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:24 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:25.979281 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-7c111f84-c11b-43b7-b00b-4561e0ac5969 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:25.980363 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-7c111f84-c11b-43b7-b00b-4561e0ac5969 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:25.987266 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7c111f84-c11b-43b7-b00b-4561e0ac5969 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:25.987962 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7c111f84-c11b-43b7-b00b-4561e0ac5969 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:25.989044 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7c111f84-c11b-43b7-b00b-4561e0ac5969 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:25.989703 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7c111f84-c11b-43b7-b00b-4561e0ac5969 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:26.064320 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-7c111f84-c11b-43b7-b00b-4561e0ac5969 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:26.071916 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-7c111f84-c11b-43b7-b00b-4561e0ac5969 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 200 len: 1466 microversion: 2.1 time: 0.096801 May 13 15:01:26.072495 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 388/744] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:25 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 1466 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:26.133445 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-f5ea1aaa-e1df-496e-9410-4d50ce2efbfa req-322e1424-68c8-4ad8-b23b-f7380fffefbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58eef483-5204-4068-bb39-476a857f0af1", "name": "network-vif-deleted", "tag": "23f1961d-71e7-41fe-a16b-42eb34061faf"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:01:26.141896 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-f5ea1aaa-e1df-496e-9410-4d50ce2efbfa req-322e1424-68c8-4ad8-b23b-f7380fffefbc service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:26.141896 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-f5ea1aaa-e1df-496e-9410-4d50ce2efbfa req-322e1424-68c8-4ad8-b23b-f7380fffefbc service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:26.155319 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-f5ea1aaa-e1df-496e-9410-4d50ce2efbfa req-322e1424-68c8-4ad8-b23b-f7380fffefbc service nova] Creating event network-vif-deleted:23f1961d-71e7-41fe-a16b-42eb34061faf for instance 58eef483-5204-4068-bb39-476a857f0af1 on hv-cinder-83090 May 13 15:01:26.161576 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-f5ea1aaa-e1df-496e-9410-4d50ce2efbfa req-322e1424-68c8-4ad8-b23b-f7380fffefbc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031645 May 13 15:01:26.162480 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 357/745] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:01:27.092257 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e3bc418d-47f0-4898-977b-d0b04b086405 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:27.093196 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e3bc418d-47f0-4898-977b-d0b04b086405 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 58eef483-5204-4068-bb39-476a857f0af1] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:27.100862 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e3bc418d-47f0-4898-977b-d0b04b086405 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:27.101314 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e3bc418d-47f0-4898-977b-d0b04b086405 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:27.102099 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e3bc418d-47f0-4898-977b-d0b04b086405 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:27.102536 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e3bc418d-47f0-4898-977b-d0b04b086405 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:27.116630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-e3bc418d-47f0-4898-977b-d0b04b086405 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] HTTP exception thrown: Instance 58eef483-5204-4068-bb39-476a857f0af1 could not be found. May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e3bc418d-47f0-4898-977b-d0b04b086405 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Request method failure captured: May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 HTTP/1.1 May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnEX_YCathXpRmMcmTHQK870dglSF1vIXxzMt9X_shkAAeZwK4OTEv8qG1yD9PbTZPRObjiSCwpvBFNAjyx-LTvGwuXfzsCenvc4jAiGwqb8FMR9nOVYkdImh9s_ciWTDSnHjkxjTZz4HRMjY3xYhYqIBKRc16CgA1qR8RAGN_F-tSg May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 55a6554838094ba8a8b807bd90ec5bf4 May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-427117176 May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:01:27.118288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:01:27.119757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a6554838094ba8a8b807bd90ec5bf4", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a6554838094ba8a8b807bd90ec5bf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a6554838094ba8a8b807bd90ec5bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a6554838094ba8a8b807bd90ec5bf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:01:27.119757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-ServerRescueNegativeTestJSON-427117176 May 13 15:01:27.119757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 55a6554838094ba8a8b807bd90ec5bf4 May 13 15:01:27.119757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-427117176 May 13 15:01:27.119757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-ServerRescueNegativeTestJSON-427117176-project May 13 15:01:27.119757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:01:27.119757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:01:27.119757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 18907451ac014573ba51f5f5f3939381 May 13 15:01:27.119757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-ServerRescueNegativeTestJSON-427117176-project May 13 15:01:27.119757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:01:27.119757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 58eef483-5204-4068-bb39-476a857f0af1 could not be found. May 13 15:01:27.119757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '58eef483-5204-4068-bb39-476a857f0af1'} May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58eef483-5204-4068-bb39-476a857f0af1 could not be found. May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:01:27.120724 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58eef483-5204-4068-bb39-476a857f0af1 could not be found. May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58eef483-5204-4068-bb39-476a857f0af1 could not be found. May 13 15:01:27.122080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:01:27.123328 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e3bc418d-47f0-4898-977b-d0b04b086405 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Returning 404 to user: Instance 58eef483-5204-4068-bb39-476a857f0af1 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:01:27.123328 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e3bc418d-47f0-4898-977b-d0b04b086405 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1" status: 404 len: 111 microversion: 2.1 time: 0.033539 May 13 15:01:27.123328 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 389/746] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:27 2022] GET /compute/v2.1/servers/58eef483-5204-4068-bb39-476a857f0af1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:01:27.131631 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-0d22093d-a2bb-4ed9-81da-25efd75a2e96 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:27.132456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-0d22093d-a2bb-4ed9-81da-25efd75a2e96 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:27.142828 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0d22093d-a2bb-4ed9-81da-25efd75a2e96 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:27.143858 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0d22093d-a2bb-4ed9-81da-25efd75a2e96 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:27.144105 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0d22093d-a2bb-4ed9-81da-25efd75a2e96 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:27.144500 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0d22093d-a2bb-4ed9-81da-25efd75a2e96 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:27.171730 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-0d22093d-a2bb-4ed9-81da-25efd75a2e96 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Going to try to terminate instance {{(pid=117296) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 15:01:27.258698 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-0d22093d-a2bb-4ed9-81da-25efd75a2e96 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "DELETE /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 204 len: 0 microversion: 2.1 time: 0.133494 May 13 15:01:27.259292 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 358/747] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:01:27 2022] DELETE /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 15:01:27.267371 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-fe1f03d2-09b4-4ee9-9b3a-0540bca62807 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:27.268020 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-fe1f03d2-09b4-4ee9-9b3a-0540bca62807 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:27.274602 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fe1f03d2-09b4-4ee9-9b3a-0540bca62807 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:27.275054 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fe1f03d2-09b4-4ee9-9b3a-0540bca62807 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:27.275796 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fe1f03d2-09b4-4ee9-9b3a-0540bca62807 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:27.276304 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fe1f03d2-09b4-4ee9-9b3a-0540bca62807 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:27.427018 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-fe1f03d2-09b4-4ee9-9b3a-0540bca62807 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:27.437415 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-fe1f03d2-09b4-4ee9-9b3a-0540bca62807 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.173762 May 13 15:01:27.438209 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 390/748] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:27 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:28.456284 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f8b7c0cb-cf0d-4d26-92f2-5dc92b2a07c5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:28.456994 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f8b7c0cb-cf0d-4d26-92f2-5dc92b2a07c5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:28.463735 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f8b7c0cb-cf0d-4d26-92f2-5dc92b2a07c5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:28.464212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f8b7c0cb-cf0d-4d26-92f2-5dc92b2a07c5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:28.464989 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f8b7c0cb-cf0d-4d26-92f2-5dc92b2a07c5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:28.465416 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f8b7c0cb-cf0d-4d26-92f2-5dc92b2a07c5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:28.603671 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f8b7c0cb-cf0d-4d26-92f2-5dc92b2a07c5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:28.613759 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f8b7c0cb-cf0d-4d26-92f2-5dc92b2a07c5 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.162020 May 13 15:01:28.614332 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 359/749] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:28 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:29.632424 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-23522ce4-79cb-429f-8355-50be52448c18 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:29.633032 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-23522ce4-79cb-429f-8355-50be52448c18 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:29.642390 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-23522ce4-79cb-429f-8355-50be52448c18 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:29.642833 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-23522ce4-79cb-429f-8355-50be52448c18 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:29.643606 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-23522ce4-79cb-429f-8355-50be52448c18 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:29.644080 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-23522ce4-79cb-429f-8355-50be52448c18 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:29.784811 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-23522ce4-79cb-429f-8355-50be52448c18 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:29.795353 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-23522ce4-79cb-429f-8355-50be52448c18 tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1523 microversion: 2.1 time: 0.167249 May 13 15:01:29.796185 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 391/750] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:29 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:30.449162 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-b5de0741-17bb-44b8-b381-3603b67f33f8 req-effb289c-e441-4527-8a13-98933071c2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4508cd58-3334-4af7-9c82-1e6e81fd4c4b", "name": "network-vif-deleted", "tag": "70ec4a68-e0ec-4b56-ba7a-43cd0cbcb156"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:01:30.458829 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-b5de0741-17bb-44b8-b381-3603b67f33f8 req-effb289c-e441-4527-8a13-98933071c2b9 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:30.459344 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-b5de0741-17bb-44b8-b381-3603b67f33f8 req-effb289c-e441-4527-8a13-98933071c2b9 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:30.470272 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-b5de0741-17bb-44b8-b381-3603b67f33f8 req-effb289c-e441-4527-8a13-98933071c2b9 service nova] Creating event network-vif-deleted:70ec4a68-e0ec-4b56-ba7a-43cd0cbcb156 for instance 4508cd58-3334-4af7-9c82-1e6e81fd4c4b on hv-cinder-83090 May 13 15:01:30.477298 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-b5de0741-17bb-44b8-b381-3603b67f33f8 req-effb289c-e441-4527-8a13-98933071c2b9 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031871 May 13 15:01:30.478294 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 360/751] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:01:30.812784 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-68ce2f05-cdf9-41a0-b6b5-7b0eebb0c60f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:30.814152 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-68ce2f05-cdf9-41a0-b6b5-7b0eebb0c60f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:30.817568 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-da41e522-4b53-48a8-a9ff-d1f20be3ad3e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:30.818553 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-da41e522-4b53-48a8-a9ff-d1f20be3ad3e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:30.821479 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68ce2f05-cdf9-41a0-b6b5-7b0eebb0c60f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:30.821931 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68ce2f05-cdf9-41a0-b6b5-7b0eebb0c60f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:30.822858 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68ce2f05-cdf9-41a0-b6b5-7b0eebb0c60f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:30.823341 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68ce2f05-cdf9-41a0-b6b5-7b0eebb0c60f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:30.825055 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-da41e522-4b53-48a8-a9ff-d1f20be3ad3e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:30.825498 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-da41e522-4b53-48a8-a9ff-d1f20be3ad3e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:30.826283 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-da41e522-4b53-48a8-a9ff-d1f20be3ad3e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:30.826724 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-da41e522-4b53-48a8-a9ff-d1f20be3ad3e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:30.856436 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68ce2f05-cdf9-41a0-b6b5-7b0eebb0c60f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:30.857156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68ce2f05-cdf9-41a0-b6b5-7b0eebb0c60f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:30.857606 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-68ce2f05-cdf9-41a0-b6b5-7b0eebb0c60f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lazy-loading 'fault' on Instance uuid 4508cd58-3334-4af7-9c82-1e6e81fd4c4b {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:01:30.858436 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-da41e522-4b53-48a8-a9ff-d1f20be3ad3e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046068 May 13 15:01:30.859227 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 361/752] 10.222.0.99 () {58 vars in 1301 bytes} [Fri May 13 15:01:30 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 15:01:30.910445 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-68ce2f05-cdf9-41a0-b6b5-7b0eebb0c60f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18907451ac014573ba51f5f5f3939381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a6554838094ba8a8b807bd90ec5bf4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:30.918643 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-68ce2f05-cdf9-41a0-b6b5-7b0eebb0c60f tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 200 len: 1312 microversion: 2.1 time: 0.109764 May 13 15:01:30.919198 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 392/753] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:30 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:30.919747 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f6c360ce-6fd5-442f-8cae-50de04f5e5a7 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:30.920293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f6c360ce-6fd5-442f-8cae-50de04f5e5a7 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:30.926684 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f6c360ce-6fd5-442f-8cae-50de04f5e5a7 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:30.927124 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f6c360ce-6fd5-442f-8cae-50de04f5e5a7 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:30.927908 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f6c360ce-6fd5-442f-8cae-50de04f5e5a7 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:30.928708 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f6c360ce-6fd5-442f-8cae-50de04f5e5a7 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:30.953010 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f6c360ce-6fd5-442f-8cae-50de04f5e5a7 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Going to try to terminate instance {{(pid=117296) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 15:01:31.031019 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f6c360ce-6fd5-442f-8cae-50de04f5e5a7 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "DELETE /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 204 len: 0 microversion: 2.1 time: 0.114846 May 13 15:01:31.031641 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 362/754] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:01:30 2022] DELETE /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 15:01:31.040118 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-1a026888-0a9a-409b-b30b-899e3df78006 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:31.040721 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-1a026888-0a9a-409b-b30b-899e3df78006 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:31.049123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1a026888-0a9a-409b-b30b-899e3df78006 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:31.049573 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1a026888-0a9a-409b-b30b-899e3df78006 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:31.050360 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1a026888-0a9a-409b-b30b-899e3df78006 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:31.050790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1a026888-0a9a-409b-b30b-899e3df78006 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:31.185812 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-1a026888-0a9a-409b-b30b-899e3df78006 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:31.193781 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-1a026888-0a9a-409b-b30b-899e3df78006 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1672 microversion: 2.1 time: 0.157639 May 13 15:01:31.194352 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 393/755] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:31 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:31.936783 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3862c65c-860f-444c-b767-6f13cb86571e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:31.937539 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-3862c65c-860f-444c-b767-6f13cb86571e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] [instance: 4508cd58-3334-4af7-9c82-1e6e81fd4c4b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:31.944264 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3862c65c-860f-444c-b767-6f13cb86571e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:31.944739 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3862c65c-860f-444c-b767-6f13cb86571e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:31.945514 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3862c65c-860f-444c-b767-6f13cb86571e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:31.945949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3862c65c-860f-444c-b767-6f13cb86571e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:31.959968 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-3862c65c-860f-444c-b767-6f13cb86571e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] HTTP exception thrown: Instance 4508cd58-3334-4af7-9c82-1e6e81fd4c4b could not be found. May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3862c65c-860f-444c-b767-6f13cb86571e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Request method failure captured: May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b HTTP/1.1 May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnEX_YCathXpRmMcmTHQK870dglSF1vIXxzMt9X_shkAAeZwK4OTEv8qG1yD9PbTZPRObjiSCwpvBFNAjyx-LTvGwuXfzsCenvc4jAiGwqb8FMR9nOVYkdImh9s_ciWTDSnHjkxjTZz4HRMjY3xYhYqIBKRc16CgA1qR8RAGN_F-tSg May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 55a6554838094ba8a8b807bd90ec5bf4 May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-427117176 May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:01:31.961615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:01:31.963007 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_55a6554838094ba8a8b807bd90ec5bf4", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a6554838094ba8a8b807bd90ec5bf4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/55a6554838094ba8a8b807bd90ec5bf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/55a6554838094ba8a8b807bd90ec5bf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:01:31.963007 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-ServerRescueNegativeTestJSON-427117176 May 13 15:01:31.963007 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 55a6554838094ba8a8b807bd90ec5bf4 May 13 15:01:31.963007 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-427117176 May 13 15:01:31.963007 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-ServerRescueNegativeTestJSON-427117176-project May 13 15:01:31.963007 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:01:31.963007 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:01:31.963007 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: 18907451ac014573ba51f5f5f3939381 May 13 15:01:31.963007 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-ServerRescueNegativeTestJSON-427117176-project May 13 15:01:31.963007 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 15:01:31.963007 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance 4508cd58-3334-4af7-9c82-1e6e81fd4c4b could not be found. May 13 15:01:31.963007 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': '4508cd58-3334-4af7-9c82-1e6e81fd4c4b'} May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4508cd58-3334-4af7-9c82-1e6e81fd4c4b could not be found. May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:01:31.963913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4508cd58-3334-4af7-9c82-1e6e81fd4c4b could not be found. May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4508cd58-3334-4af7-9c82-1e6e81fd4c4b could not be found. May 13 15:01:31.965192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:01:31.966219 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3862c65c-860f-444c-b767-6f13cb86571e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] Returning 404 to user: Instance 4508cd58-3334-4af7-9c82-1e6e81fd4c4b could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:01:31.966219 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-3862c65c-860f-444c-b767-6f13cb86571e tempest-ServerRescueNegativeTestJSON-427117176 tempest-ServerRescueNegativeTestJSON-427117176-project] 10.222.0.99 "GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b" status: 404 len: 111 microversion: 2.1 time: 0.030553 May 13 15:01:31.966219 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 363/756] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:31 2022] GET /compute/v2.1/servers/4508cd58-3334-4af7-9c82-1e6e81fd4c4b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:01:32.212377 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-08965a48-271a-4539-8a8e-33e61ffac029 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:32.213000 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-08965a48-271a-4539-8a8e-33e61ffac029 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:32.219855 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-08965a48-271a-4539-8a8e-33e61ffac029 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:32.220984 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-08965a48-271a-4539-8a8e-33e61ffac029 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:32.221780 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-08965a48-271a-4539-8a8e-33e61ffac029 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:32.222221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-08965a48-271a-4539-8a8e-33e61ffac029 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:32.482248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-08965a48-271a-4539-8a8e-33e61ffac029 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:32.490512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-08965a48-271a-4539-8a8e-33e61ffac029 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1672 microversion: 2.1 time: 0.283422 May 13 15:01:32.491092 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 394/757] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:32 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1672 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:33.393194 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-214f946d-56c5-4c4b-9b97-7bbc9299554b req-29510b2a-cb19-4228-8cd2-60932380dedc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b68ffc-74f1-4850-ba58-9504e3b5c4c7", "name": "network-vif-deleted", "tag": "9586d7b9-e756-4c7c-b9ba-629358746fdc"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:01:33.401349 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-214f946d-56c5-4c4b-9b97-7bbc9299554b req-29510b2a-cb19-4228-8cd2-60932380dedc service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:33.401780 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-214f946d-56c5-4c4b-9b97-7bbc9299554b req-29510b2a-cb19-4228-8cd2-60932380dedc service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:33.414548 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-214f946d-56c5-4c4b-9b97-7bbc9299554b req-29510b2a-cb19-4228-8cd2-60932380dedc service nova] Creating event network-vif-deleted:9586d7b9-e756-4c7c-b9ba-629358746fdc for instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 on hv-cinder-83090 May 13 15:01:33.419737 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-214f946d-56c5-4c4b-9b97-7bbc9299554b req-29510b2a-cb19-4228-8cd2-60932380dedc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030490 May 13 15:01:33.420524 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 364/758] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:01:33.512022 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d81e18f0-0cf3-4019-b66d-7d2ac1e76129 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:33.521648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d81e18f0-0cf3-4019-b66d-7d2ac1e76129 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:33.538154 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d81e18f0-0cf3-4019-b66d-7d2ac1e76129 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:33.541637 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d81e18f0-0cf3-4019-b66d-7d2ac1e76129 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:33.544434 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d81e18f0-0cf3-4019-b66d-7d2ac1e76129 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:33.546798 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d81e18f0-0cf3-4019-b66d-7d2ac1e76129 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:33.712758 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d81e18f0-0cf3-4019-b66d-7d2ac1e76129 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:33.724070 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d81e18f0-0cf3-4019-b66d-7d2ac1e76129 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 200 len: 1323 microversion: 2.1 time: 0.219283 May 13 15:01:33.726721 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 395/759] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:33 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 1323 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:34.742283 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cedee088-0e64-47f9-ae0c-f79da089fcb8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:34.743281 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-cedee088-0e64-47f9-ae0c-f79da089fcb8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:34.749548 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cedee088-0e64-47f9-ae0c-f79da089fcb8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:34.749990 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cedee088-0e64-47f9-ae0c-f79da089fcb8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:34.750761 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cedee088-0e64-47f9-ae0c-f79da089fcb8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:34.751318 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cedee088-0e64-47f9-ae0c-f79da089fcb8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:34.767027 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-cedee088-0e64-47f9-ae0c-f79da089fcb8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] HTTP exception thrown: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cedee088-0e64-47f9-ae0c-f79da089fcb8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Request method failure captured: May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 HTTP/1.1 May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnEUgwNuADqWE8tnVfUktdo9bbfNPZiyT_WOUx-UalXYA9DosMTf697mKThsqrWLYLjq5XxgrwZkLSqVtRuVNvD5QCJOY-w0-xiIargULPVZ9UJQPsXdHeELIvw5t7DWjJnvaNaBb69YHIhMaS8n9RGcQ3UEDVYcVb4gbhweiNpTKRo May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 634e7491dc6e43f98fb82baba250b09b May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-AttachVolumeTestJSON-207340798 May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:01:34.769540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:01:34.771073 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_634e7491dc6e43f98fb82baba250b09b", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:01:34.771073 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-AttachVolumeTestJSON-207340798 May 13 15:01:34.771073 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 634e7491dc6e43f98fb82baba250b09b May 13 15:01:34.771073 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-AttachVolumeTestJSON-207340798 May 13 15:01:34.771073 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-AttachVolumeTestJSON-207340798-project May 13 15:01:34.771073 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:01:34.771073 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:01:34.771073 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: fbe6cc242fbf40cf8250dabaa336f648 May 13 15:01:34.771073 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-AttachVolumeTestJSON-207340798-project May 13 15:01:34.771073 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 15:01:34.771073 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. May 13 15:01:34.771073 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': '37b68ffc-74f1-4850-ba58-9504e3b5c4c7'} May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:01:34.772025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. May 13 15:01:34.773459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:01:34.774700 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cedee088-0e64-47f9-ae0c-f79da089fcb8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Returning 404 to user: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:01:34.774700 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-cedee088-0e64-47f9-ae0c-f79da089fcb8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 404 len: 111 microversion: 2.1 time: 0.033492 May 13 15:01:34.774700 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 365/760] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:34 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 15:01:34.781820 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-7913d43a-6f36-42a5-b444-e9b2ddf33553 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '.version_select at 0x7fcf4ca959d0>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:34.802384 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-7913d43a-6f36-42a5-b444-e9b2ddf33553 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1202549777" status: 202 len: 0 microversion: 2.1 time: 0.024359 May 13 15:01:34.802973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 396/761] 10.222.0.99 () {58 vars in 1220 bytes} [Fri May 13 15:01:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1202549777 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 15:01:35.461323 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b1032a12-dc72-46f5-b0a4-1e38ec71388e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Action: 'create', calling method: .version_select at 0x7fcf480d6e50>, body: {"keypair": {"name": "tempest-keypair-420527209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBtwxa2Gh/OKpy1/l/ubsDrOPPtkY7oB/JH0j7wbgo2YdMriPbekgG5iIg8FL1xMCK4sbyqpjvEL8MQpyic2yTucvTEhPz+dY4Em7BsRuQjunYJKxT/2zMjE7G3O3tX4zQ=="}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:01:35.487098 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-b1032a12-dc72-46f5-b0a4-1e38ec71388e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Getting quotas for project 634e7491dc6e43f98fb82baba250b09b. Resources: {'key_pairs'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 15:01:35.493507 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-b1032a12-dc72-46f5-b0a4-1e38ec71388e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Getting quotas for user fbe6cc242fbf40cf8250dabaa336f648 and project 634e7491dc6e43f98fb82baba250b09b. Resources: {'key_pairs'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 15:01:35.532830 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b1032a12-dc72-46f5-b0a4-1e38ec71388e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075241 May 13 15:01:35.533695 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 366/762] 10.222.0.99 () {60 vars in 1158 bytes} [Fri May 13 15:01:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:01:37.176516 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-5b17459c-1fdd-4b30-8e3e-2ae640bc7443 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-499398863", "imageRef": "eac0bc7b-d963-4624-aba3-a81fd1bf324c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d5b153a-6477-4cd2-b1f3-e03c30c658fe"}], "security_groups": [{"name": "tempest-securitygroup--239925196"}], "key_name": "tempest-keypair-420527209", "user_data": "}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:01:37.277254 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.network.neutron [None req-5b17459c-1fdd-4b30-8e3e-2ae640bc7443 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] validate_networks() for [('8d5b153a-6477-4cd2-b1f3-e03c30c658fe', None, None, None, None, None)] {{(pid=117295) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 15:01:37.650437 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-5b17459c-1fdd-4b30-8e3e-2ae640bc7443 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Flavor limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 15:01:37.650878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-5b17459c-1fdd-4b30-8e3e-2ae640bc7443 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Image limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 15:01:37.651297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-5b17459c-1fdd-4b30-8e3e-2ae640bc7443 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Flavor pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 15:01:37.651769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-5b17459c-1fdd-4b30-8e3e-2ae640bc7443 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Image pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 15:01:37.652110 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-5b17459c-1fdd-4b30-8e3e-2ae640bc7443 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 15:01:37.661146 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5b17459c-1fdd-4b30-8e3e-2ae640bc7443 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:37.661582 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5b17459c-1fdd-4b30-8e3e-2ae640bc7443 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:37.662622 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5b17459c-1fdd-4b30-8e3e-2ae640bc7443 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:37.663040 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5b17459c-1fdd-4b30-8e3e-2ae640bc7443 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:37.678972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-5b17459c-1fdd-4b30-8e3e-2ae640bc7443 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Getting quotas for project 634e7491dc6e43f98fb82baba250b09b. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 15:01:37.682717 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-5b17459c-1fdd-4b30-8e3e-2ae640bc7443 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Getting quotas for user fbe6cc242fbf40cf8250dabaa336f648 and project 634e7491dc6e43f98fb82baba250b09b. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 15:01:37.693054 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-5b17459c-1fdd-4b30-8e3e-2ae640bc7443 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Going to run 1 instances... {{(pid=117295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 15:01:37.695307 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-5b17459c-1fdd-4b30-8e3e-2ae640bc7443 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac0bc7b-d963-4624-aba3-a81fd1bf324c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 15:01:37.744654 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-5b17459c-1fdd-4b30-8e3e-2ae640bc7443 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.573230 May 13 15:01:37.745473 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 397/763] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 15:01:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 15:01:37.756110 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cb3ab072-7dea-41a0-89da-20443796d89e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:37.757033 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-cb3ab072-7dea-41a0-89da-20443796d89e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:37.830679 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-cb3ab072-7dea-41a0-89da-20443796d89e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:37.850640 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-cb3ab072-7dea-41a0-89da-20443796d89e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1236 microversion: 2.1 time: 0.088682 May 13 15:01:37.851225 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 367/764] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:37 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1236 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:38.868902 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e5944b1c-93e9-4197-a5fe-57b5a532d42f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:38.870212 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e5944b1c-93e9-4197-a5fe-57b5a532d42f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:38.879477 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e5944b1c-93e9-4197-a5fe-57b5a532d42f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:38.880209 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e5944b1c-93e9-4197-a5fe-57b5a532d42f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:38.882261 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e5944b1c-93e9-4197-a5fe-57b5a532d42f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:38.883101 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e5944b1c-93e9-4197-a5fe-57b5a532d42f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:38.952305 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e5944b1c-93e9-4197-a5fe-57b5a532d42f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:38.963547 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e5944b1c-93e9-4197-a5fe-57b5a532d42f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1306 microversion: 2.1 time: 0.098411 May 13 15:01:38.971839 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 398/765] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:38 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:39.982489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-24ef1803-da01-4ba9-83d9-8b18f2147277 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:39.983245 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-24ef1803-da01-4ba9-83d9-8b18f2147277 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:39.991458 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24ef1803-da01-4ba9-83d9-8b18f2147277 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:39.991969 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24ef1803-da01-4ba9-83d9-8b18f2147277 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:39.992823 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24ef1803-da01-4ba9-83d9-8b18f2147277 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:39.993291 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24ef1803-da01-4ba9-83d9-8b18f2147277 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:40.135805 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-24ef1803-da01-4ba9-83d9-8b18f2147277 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:40.143544 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-24ef1803-da01-4ba9-83d9-8b18f2147277 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1361 microversion: 2.1 time: 0.165624 May 13 15:01:40.153235 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 368/766] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:39 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:40.261626 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-2fd872fc-ea23-41b4-bd23-ace6ffeab2e5 req-bb467144-4572-4417-b1a7-c52fbe935161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d93a166-e753-4779-bd52-67f67445c3c9", "tag": "b93715cd-b844-448b-8661-4c58ce13542c"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:01:40.277192 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-2fd872fc-ea23-41b4-bd23-ace6ffeab2e5 req-bb467144-4572-4417-b1a7-c52fbe935161 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:40.278534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-2fd872fc-ea23-41b4-bd23-ace6ffeab2e5 req-bb467144-4572-4417-b1a7-c52fbe935161 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:40.304195 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-2fd872fc-ea23-41b4-bd23-ace6ffeab2e5 req-bb467144-4572-4417-b1a7-c52fbe935161 service nova] Creating event network-changed:b93715cd-b844-448b-8661-4c58ce13542c for instance 6d93a166-e753-4779-bd52-67f67445c3c9 on hv-cinder-83090 May 13 15:01:40.309156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-2fd872fc-ea23-41b4-bd23-ace6ffeab2e5 req-bb467144-4572-4417-b1a7-c52fbe935161 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051196 May 13 15:01:40.309782 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 399/767] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 15:01:41.160697 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-311c2621-6934-4653-863b-a24b1cf85794 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:41.161303 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-311c2621-6934-4653-863b-a24b1cf85794 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:41.167469 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-311c2621-6934-4653-863b-a24b1cf85794 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:41.167947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-311c2621-6934-4653-863b-a24b1cf85794 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:41.168766 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-311c2621-6934-4653-863b-a24b1cf85794 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:41.169240 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-311c2621-6934-4653-863b-a24b1cf85794 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:41.301228 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-311c2621-6934-4653-863b-a24b1cf85794 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:41.308745 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-311c2621-6934-4653-863b-a24b1cf85794 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1361 microversion: 2.1 time: 0.152114 May 13 15:01:41.309394 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 369/768] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:41 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 15:01:42.326997 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ddb1e8be-e071-49a9-bb10-1831b159f3ed tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:42.327681 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ddb1e8be-e071-49a9-bb10-1831b159f3ed tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:42.334400 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ddb1e8be-e071-49a9-bb10-1831b159f3ed tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:42.334847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ddb1e8be-e071-49a9-bb10-1831b159f3ed tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:42.335670 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ddb1e8be-e071-49a9-bb10-1831b159f3ed tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:42.336143 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ddb1e8be-e071-49a9-bb10-1831b159f3ed tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:42.473528 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ddb1e8be-e071-49a9-bb10-1831b159f3ed tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:42.483683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ddb1e8be-e071-49a9-bb10-1831b159f3ed tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1361 microversion: 2.1 time: 0.161744 May 13 15:01:42.484323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 400/769] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:42 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:43.500912 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a8bf3e0a-9132-41ac-84d2-709a922e5ae0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:43.501535 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a8bf3e0a-9132-41ac-84d2-709a922e5ae0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:43.508093 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a8bf3e0a-9132-41ac-84d2-709a922e5ae0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:43.508581 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a8bf3e0a-9132-41ac-84d2-709a922e5ae0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:43.509368 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a8bf3e0a-9132-41ac-84d2-709a922e5ae0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:43.509778 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a8bf3e0a-9132-41ac-84d2-709a922e5ae0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:43.654984 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-a8bf3e0a-9132-41ac-84d2-709a922e5ae0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:43.663019 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a8bf3e0a-9132-41ac-84d2-709a922e5ae0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1361 microversion: 2.1 time: 0.166020 May 13 15:01:43.663588 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 370/770] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:43 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:44.680605 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e4a4bc6a-2670-4858-9626-ac5ab4e0a09b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:44.681215 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e4a4bc6a-2670-4858-9626-ac5ab4e0a09b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:44.687606 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e4a4bc6a-2670-4858-9626-ac5ab4e0a09b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:44.688089 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e4a4bc6a-2670-4858-9626-ac5ab4e0a09b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:44.688882 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e4a4bc6a-2670-4858-9626-ac5ab4e0a09b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:44.689311 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e4a4bc6a-2670-4858-9626-ac5ab4e0a09b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:44.824435 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e4a4bc6a-2670-4858-9626-ac5ab4e0a09b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:44.836295 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e4a4bc6a-2670-4858-9626-ac5ab4e0a09b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1361 microversion: 2.1 time: 0.159302 May 13 15:01:44.837157 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 401/771] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:44 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:45.862525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-37acf272-4814-4cbc-8631-dc909954b842 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:45.863722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-37acf272-4814-4cbc-8631-dc909954b842 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:45.870285 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-37acf272-4814-4cbc-8631-dc909954b842 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:45.870734 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-37acf272-4814-4cbc-8631-dc909954b842 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:45.871508 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-37acf272-4814-4cbc-8631-dc909954b842 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:45.871973 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-37acf272-4814-4cbc-8631-dc909954b842 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:46.000926 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-37acf272-4814-4cbc-8631-dc909954b842 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:46.008989 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-37acf272-4814-4cbc-8631-dc909954b842 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1361 microversion: 2.1 time: 0.153145 May 13 15:01:46.009564 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 371/772] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:45 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:47.029458 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-67110a9a-1f29-4b8a-a258-c47a7c5eb073 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:47.030065 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-67110a9a-1f29-4b8a-a258-c47a7c5eb073 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:47.038176 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-67110a9a-1f29-4b8a-a258-c47a7c5eb073 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:47.038618 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-67110a9a-1f29-4b8a-a258-c47a7c5eb073 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:47.039385 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-67110a9a-1f29-4b8a-a258-c47a7c5eb073 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:47.039819 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-67110a9a-1f29-4b8a-a258-c47a7c5eb073 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:47.447299 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-67110a9a-1f29-4b8a-a258-c47a7c5eb073 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:47.457766 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-67110a9a-1f29-4b8a-a258-c47a7c5eb073 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1361 microversion: 2.1 time: 0.434411 May 13 15:01:47.458342 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 402/773] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:47 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1361 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:48.477467 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c788fac6-a22a-4ac4-be9c-a00126864a50 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:48.478357 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c788fac6-a22a-4ac4-be9c-a00126864a50 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:48.486786 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c788fac6-a22a-4ac4-be9c-a00126864a50 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:48.487350 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c788fac6-a22a-4ac4-be9c-a00126864a50 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:48.488369 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c788fac6-a22a-4ac4-be9c-a00126864a50 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:48.488916 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c788fac6-a22a-4ac4-be9c-a00126864a50 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:48.624695 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c788fac6-a22a-4ac4-be9c-a00126864a50 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:48.633523 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c788fac6-a22a-4ac4-be9c-a00126864a50 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1361 microversion: 2.1 time: 0.161871 May 13 15:01:48.634003 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 372/774] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:48 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:49.651066 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-369d6cbc-17e2-4e8e-8c04-ff65ef2b5264 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:49.651681 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-369d6cbc-17e2-4e8e-8c04-ff65ef2b5264 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:49.658676 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-369d6cbc-17e2-4e8e-8c04-ff65ef2b5264 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:49.659120 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-369d6cbc-17e2-4e8e-8c04-ff65ef2b5264 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:49.659902 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-369d6cbc-17e2-4e8e-8c04-ff65ef2b5264 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:49.660380 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-369d6cbc-17e2-4e8e-8c04-ff65ef2b5264 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:49.801174 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-369d6cbc-17e2-4e8e-8c04-ff65ef2b5264 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:49.808745 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-369d6cbc-17e2-4e8e-8c04-ff65ef2b5264 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1361 microversion: 2.1 time: 0.161877 May 13 15:01:49.809711 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 403/775] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:49 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:49.861452 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-2e66915d-7b16-47d7-b1de-52c4573e5d7c req-07885840-925a-49e2-9bca-3433eb7ca46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d93a166-e753-4779-bd52-67f67445c3c9", "name": "network-vif-plugged", "status": "completed", "tag": "b93715cd-b844-448b-8661-4c58ce13542c"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:01:49.872760 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-2e66915d-7b16-47d7-b1de-52c4573e5d7c req-07885840-925a-49e2-9bca-3433eb7ca46d service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:49.873560 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-2e66915d-7b16-47d7-b1de-52c4573e5d7c req-07885840-925a-49e2-9bca-3433eb7ca46d service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:49.886304 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-2e66915d-7b16-47d7-b1de-52c4573e5d7c req-07885840-925a-49e2-9bca-3433eb7ca46d service nova] Creating event network-vif-plugged:b93715cd-b844-448b-8661-4c58ce13542c for instance 6d93a166-e753-4779-bd52-67f67445c3c9 on hv-cinder-83090 May 13 15:01:49.893289 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-2e66915d-7b16-47d7-b1de-52c4573e5d7c req-07885840-925a-49e2-9bca-3433eb7ca46d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036909 May 13 15:01:49.894106 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 373/776] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:01:50.829772 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-b38c3037-97d3-4298-b4d2-bfdc89d18ae5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:50.830739 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-b38c3037-97d3-4298-b4d2-bfdc89d18ae5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:50.841784 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b38c3037-97d3-4298-b4d2-bfdc89d18ae5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:50.842530 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b38c3037-97d3-4298-b4d2-bfdc89d18ae5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:50.843801 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b38c3037-97d3-4298-b4d2-bfdc89d18ae5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:50.844587 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b38c3037-97d3-4298-b4d2-bfdc89d18ae5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:50.975853 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b38c3037-97d3-4298-b4d2-bfdc89d18ae5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:50.987722 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-b38c3037-97d3-4298-b4d2-bfdc89d18ae5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1361 microversion: 2.1 time: 0.164364 May 13 15:01:50.988356 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 404/777] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:50 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:52.010234 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-90c2d1d4-1799-4b1c-9dbf-3162b09e2f90 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:52.011376 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-90c2d1d4-1799-4b1c-9dbf-3162b09e2f90 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:52.021609 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-90c2d1d4-1799-4b1c-9dbf-3162b09e2f90 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:52.022056 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-90c2d1d4-1799-4b1c-9dbf-3162b09e2f90 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:52.022842 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-90c2d1d4-1799-4b1c-9dbf-3162b09e2f90 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:52.023302 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-90c2d1d4-1799-4b1c-9dbf-3162b09e2f90 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:52.159103 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-90c2d1d4-1799-4b1c-9dbf-3162b09e2f90 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:52.167780 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-90c2d1d4-1799-4b1c-9dbf-3162b09e2f90 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1361 microversion: 2.1 time: 0.165256 May 13 15:01:52.168386 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 374/778] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:52 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:53.188853 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c382d929-d4ab-40e8-8cdd-159c9ff9efc7 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:53.189835 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c382d929-d4ab-40e8-8cdd-159c9ff9efc7 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:53.197913 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c382d929-d4ab-40e8-8cdd-159c9ff9efc7 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:53.198367 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c382d929-d4ab-40e8-8cdd-159c9ff9efc7 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:53.199143 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c382d929-d4ab-40e8-8cdd-159c9ff9efc7 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:53.199581 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c382d929-d4ab-40e8-8cdd-159c9ff9efc7 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:53.337064 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c382d929-d4ab-40e8-8cdd-159c9ff9efc7 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:53.344457 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c382d929-d4ab-40e8-8cdd-159c9ff9efc7 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1361 microversion: 2.1 time: 0.162180 May 13 15:01:53.345018 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 405/779] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:53 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:54.361449 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c04d8147-b101-44f6-8967-de903c0c4362 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:54.362055 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c04d8147-b101-44f6-8967-de903c0c4362 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:54.368998 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c04d8147-b101-44f6-8967-de903c0c4362 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:54.369449 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c04d8147-b101-44f6-8967-de903c0c4362 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:54.370211 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c04d8147-b101-44f6-8967-de903c0c4362 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:54.370643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c04d8147-b101-44f6-8967-de903c0c4362 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:54.504898 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c04d8147-b101-44f6-8967-de903c0c4362 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:54.512679 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c04d8147-b101-44f6-8967-de903c0c4362 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1361 microversion: 2.1 time: 0.155066 May 13 15:01:54.513267 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 375/780] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:54 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:55.530169 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-67240edd-767a-4702-8475-186d9fd58c05 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:55.530779 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-67240edd-767a-4702-8475-186d9fd58c05 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:55.537625 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-67240edd-767a-4702-8475-186d9fd58c05 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:55.538126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-67240edd-767a-4702-8475-186d9fd58c05 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:55.538907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-67240edd-767a-4702-8475-186d9fd58c05 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:55.539363 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-67240edd-767a-4702-8475-186d9fd58c05 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:55.683696 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-67240edd-767a-4702-8475-186d9fd58c05 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:55.693366 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-67240edd-767a-4702-8475-186d9fd58c05 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1361 microversion: 2.1 time: 0.167050 May 13 15:01:55.694146 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 406/781] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:55 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:56.711031 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-94fa5d73-7f8e-4725-832b-3196b716dd78 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:56.711643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-94fa5d73-7f8e-4725-832b-3196b716dd78 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:56.718548 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-94fa5d73-7f8e-4725-832b-3196b716dd78 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:56.719017 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-94fa5d73-7f8e-4725-832b-3196b716dd78 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:56.719832 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-94fa5d73-7f8e-4725-832b-3196b716dd78 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:56.720299 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-94fa5d73-7f8e-4725-832b-3196b716dd78 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:56.862604 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-94fa5d73-7f8e-4725-832b-3196b716dd78 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:56.871352 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-94fa5d73-7f8e-4725-832b-3196b716dd78 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1361 microversion: 2.1 time: 0.164074 May 13 15:01:56.872138 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 376/782] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:56 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:57.887839 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-a93429ec-9989-4ef1-85cd-e5efbd386c6a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:57.888506 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-a93429ec-9989-4ef1-85cd-e5efbd386c6a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:57.894837 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a93429ec-9989-4ef1-85cd-e5efbd386c6a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:57.895278 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a93429ec-9989-4ef1-85cd-e5efbd386c6a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:57.896731 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a93429ec-9989-4ef1-85cd-e5efbd386c6a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:57.897179 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a93429ec-9989-4ef1-85cd-e5efbd386c6a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:58.042385 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-a93429ec-9989-4ef1-85cd-e5efbd386c6a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:01:58.050116 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-a93429ec-9989-4ef1-85cd-e5efbd386c6a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1547 microversion: 2.1 time: 0.166218 May 13 15:01:58.050660 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 407/783] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:01:57 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:01:58.066351 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-0c08789c-b6a4-4521-92b7-12d8b291c5b5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:01:58.066902 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-0c08789c-b6a4-4521-92b7-12d8b291c5b5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:01:58.073818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0c08789c-b6a4-4521-92b7-12d8b291c5b5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:58.074386 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0c08789c-b6a4-4521-92b7-12d8b291c5b5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:58.075162 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0c08789c-b6a4-4521-92b7-12d8b291c5b5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:58.075600 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0c08789c-b6a4-4521-92b7-12d8b291c5b5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:58.162643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-0c08789c-b6a4-4521-92b7-12d8b291c5b5 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100199 May 13 15:01:58.163250 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 377/784] 10.222.0.99 () {58 vars in 1274 bytes} [Fri May 13 15:01:58 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:01:59.190786 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-944a1960-c661-4895-9f57-9ad279fa05ec req-4d812314-2179-471d-ade1-3f61a49b05c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d93a166-e753-4779-bd52-67f67445c3c9", "tag": "b93715cd-b844-448b-8661-4c58ce13542c"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:01:59.200082 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-944a1960-c661-4895-9f57-9ad279fa05ec req-4d812314-2179-471d-ade1-3f61a49b05c0 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:01:59.200597 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-944a1960-c661-4895-9f57-9ad279fa05ec req-4d812314-2179-471d-ade1-3f61a49b05c0 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:01:59.212073 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-944a1960-c661-4895-9f57-9ad279fa05ec req-4d812314-2179-471d-ade1-3f61a49b05c0 service nova] Creating event network-changed:b93715cd-b844-448b-8661-4c58ce13542c for instance 6d93a166-e753-4779-bd52-67f67445c3c9 on hv-cinder-83090 May 13 15:01:59.217315 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-944a1960-c661-4895-9f57-9ad279fa05ec req-4d812314-2179-471d-ade1-3f61a49b05c0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030422 May 13 15:01:59.217911 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 408/785] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:02:17.033275 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-446a7685-33e1-4a79-a1e5-49b67530f5d1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:17.033953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-446a7685-33e1-4a79-a1e5-49b67530f5d1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:17.040823 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-446a7685-33e1-4a79-a1e5-49b67530f5d1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:17.041271 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-446a7685-33e1-4a79-a1e5-49b67530f5d1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:17.042052 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-446a7685-33e1-4a79-a1e5-49b67530f5d1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:17.042542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-446a7685-33e1-4a79-a1e5-49b67530f5d1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:17.065498 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-446a7685-33e1-4a79-a1e5-49b67530f5d1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5/ips" status: 200 len: 150 microversion: 2.1 time: 0.039321 May 13 15:02:17.066209 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 378/786] 10.222.0.99 () {58 vars in 1247 bytes} [Fri May 13 15:02:17 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:02:18.414215 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e9d2c2a1-acaf-492b-8a6e-e79db6c6acc4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f650f303-f87e-4864-b201-c83d58774245"}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:02:18.415350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e9d2c2a1-acaf-492b-8a6e-e79db6c6acc4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:18.422020 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e9d2c2a1-acaf-492b-8a6e-e79db6c6acc4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:18.422460 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e9d2c2a1-acaf-492b-8a6e-e79db6c6acc4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:18.423227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e9d2c2a1-acaf-492b-8a6e-e79db6c6acc4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:18.423657 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e9d2c2a1-acaf-492b-8a6e-e79db6c6acc4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:18.713827 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e9d2c2a1-acaf-492b-8a6e-e79db6c6acc4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "POST /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304332 May 13 15:02:18.714512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 409/787] 10.222.0.99 () {60 vars in 1322 bytes} [Fri May 13 15:02:18 2022] POST /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:02:26.245920 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6961a17c-8929-4eff-89b1-c0ea3eb221d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f650f303-f87e-4864-b201-c83d58774245"}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:02:26.246989 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6961a17c-8929-4eff-89b1-c0ea3eb221d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:26.253688 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6961a17c-8929-4eff-89b1-c0ea3eb221d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:26.254130 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6961a17c-8929-4eff-89b1-c0ea3eb221d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:26.254982 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6961a17c-8929-4eff-89b1-c0ea3eb221d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:26.255419 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6961a17c-8929-4eff-89b1-c0ea3eb221d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:26.334603 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-6961a17c-8929-4eff-89b1-c0ea3eb221d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] HTTP exception thrown: Invalid volume: volume f650f303-f87e-4864-b201-c83d58774245 is already attached to instances: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6961a17c-8929-4eff-89b1-c0ea3eb221d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Request method failure captured: May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: POST /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5/os-volume_attachments HTTP/1.1 May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 74 May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnETlq5ud0tLso0I4BZTgYxPV45uNUu133mcSZWQF8BrY5W-G7qjq44vNdtUOkhBY1NV_9YSUowwjJ-SwPRew__XdEJEaAD7-9rhSJZVxBqaksNyEovGIgePKTwhLV_b-Jq67lITHd9QMI2kWMsWgOPV6MBxPM4K-LIG_E6GaM8BRTg May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:02:26.336381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:02:26.337953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8ff6bdb0a99948698dc413c12b120b61", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:02:26.337953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:02:26.337953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:02:26.337953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:02:26.337953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:02:26.337953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:02:26.337953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:02:26.337953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: 1ded6e90b10949dcb921119073f2d26a May 13 15:02:26.337953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:02:26.337953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: May 13 15:02:26.337953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {"volumeAttachment": {"volumeId": "f650f303-f87e-4864-b201-c83d58774245"}} May 13 15:02:26.337953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Invalid volume: volume f650f303-f87e-4864-b201-c83d58774245 is already attached to instances: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'server_id': 'cf1ec1b0-5a88-48de-8329-bd0b9792b8d5', 'body': {'volumeAttachment': {'volumeId': 'f650f303-f87e-4864-b201-c83d58774245'}}} May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f650f303-f87e-4864-b201-c83d58774245 is already attached to instances: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:02:26.338870 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f650f303-f87e-4864-b201-c83d58774245 is already attached to instances: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:02:26.340379 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:02:26.342464 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:02:26.342464 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:02:26.342464 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:02:26.342464 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f650f303-f87e-4864-b201-c83d58774245 is already attached to instances: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 May 13 15:02:26.342464 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:02:26.342464 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6961a17c-8929-4eff-89b1-c0ea3eb221d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Returning 400 to user: Invalid volume: volume f650f303-f87e-4864-b201-c83d58774245 is already attached to instances: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:02:26.342464 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6961a17c-8929-4eff-89b1-c0ea3eb221d2 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "POST /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095994 May 13 15:02:26.342464 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 379/788] 10.222.0.99 () {60 vars in 1322 bytes} [Fri May 13 15:02:26 2022] POST /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 15:02:26.406385 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-7425fdc6-0c2b-43c5-b049-c30ad4f6c90e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:26.406992 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-7425fdc6-0c2b-43c5-b049-c30ad4f6c90e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:26.414045 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7425fdc6-0c2b-43c5-b049-c30ad4f6c90e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:26.414492 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7425fdc6-0c2b-43c5-b049-c30ad4f6c90e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:26.415297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7425fdc6-0c2b-43c5-b049-c30ad4f6c90e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:26.415733 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7425fdc6-0c2b-43c5-b049-c30ad4f6c90e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:26.497204 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-7425fdc6-0c2b-43c5-b049-c30ad4f6c90e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lazy-loading 'services' on Instance uuid cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:02:26.576130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-7425fdc6-0c2b-43c5-b049-c30ad4f6c90e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "DELETE /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5/os-volume_attachments/f650f303-f87e-4864-b201-c83d58774245" status: 202 len: 0 microversion: 2.1 time: 0.174312 May 13 15:02:26.576726 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 410/789] 10.222.0.99 () {58 vars in 1415 bytes} [Fri May 13 15:02:26 2022] DELETE /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5/os-volume_attachments/f650f303-f87e-4864-b201-c83d58774245 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:02:26.587668 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cef4c0ba-1a0b-4052-acbc-4545396c57cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:26.588834 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-cef4c0ba-1a0b-4052-acbc-4545396c57cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:26.596204 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cef4c0ba-1a0b-4052-acbc-4545396c57cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:26.596596 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cef4c0ba-1a0b-4052-acbc-4545396c57cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:26.597377 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cef4c0ba-1a0b-4052-acbc-4545396c57cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:26.597826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cef4c0ba-1a0b-4052-acbc-4545396c57cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:26.629771 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-cef4c0ba-1a0b-4052-acbc-4545396c57cf tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046657 May 13 15:02:26.630668 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 380/790] 10.222.0.99 () {58 vars in 1301 bytes} [Fri May 13 15:02:26 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 15:02:27.642672 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-014177e0-1789-4bda-ae02-a38d3efea960 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:27.643901 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-014177e0-1789-4bda-ae02-a38d3efea960 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:27.651242 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-014177e0-1789-4bda-ae02-a38d3efea960 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:27.651784 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-014177e0-1789-4bda-ae02-a38d3efea960 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:27.652666 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-014177e0-1789-4bda-ae02-a38d3efea960 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:27.653335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-014177e0-1789-4bda-ae02-a38d3efea960 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:27.684231 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-014177e0-1789-4bda-ae02-a38d3efea960 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046456 May 13 15:02:27.684807 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 411/791] 10.222.0.99 () {58 vars in 1301 bytes} [Fri May 13 15:02:27 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 15:02:27.743816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a2bea3f5-5918-431d-a139-ee0f47bbbe12 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:27.744412 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a2bea3f5-5918-431d-a139-ee0f47bbbe12 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:27.752047 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a2bea3f5-5918-431d-a139-ee0f47bbbe12 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:27.752566 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a2bea3f5-5918-431d-a139-ee0f47bbbe12 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:27.753557 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a2bea3f5-5918-431d-a139-ee0f47bbbe12 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:27.754063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a2bea3f5-5918-431d-a139-ee0f47bbbe12 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:27.779818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a2bea3f5-5918-431d-a139-ee0f47bbbe12 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Going to try to terminate instance {{(pid=117296) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 15:02:27.873001 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a2bea3f5-5918-431d-a139-ee0f47bbbe12 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "DELETE /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 204 len: 0 microversion: 2.1 time: 0.133241 May 13 15:02:27.873920 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 381/792] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:02:27 2022] DELETE /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 15:02:27.886256 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-280d9858-2539-44df-8011-282002323219 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:27.887443 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-280d9858-2539-44df-8011-282002323219 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:27.903483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-280d9858-2539-44df-8011-282002323219 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:27.903945 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-280d9858-2539-44df-8011-282002323219 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:27.904946 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-280d9858-2539-44df-8011-282002323219 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:27.905379 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-280d9858-2539-44df-8011-282002323219 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:28.054553 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-280d9858-2539-44df-8011-282002323219 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:28.061837 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-280d9858-2539-44df-8011-282002323219 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 200 len: 1682 microversion: 2.1 time: 0.183073 May 13 15:02:28.062551 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 412/793] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:02:27 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:02:29.079919 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-067de0ab-e433-48a1-92cd-72eab6214a2a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:29.080630 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-067de0ab-e433-48a1-92cd-72eab6214a2a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:29.087571 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-067de0ab-e433-48a1-92cd-72eab6214a2a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:29.088074 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-067de0ab-e433-48a1-92cd-72eab6214a2a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:29.088876 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-067de0ab-e433-48a1-92cd-72eab6214a2a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:29.089306 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-067de0ab-e433-48a1-92cd-72eab6214a2a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:29.222283 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-067de0ab-e433-48a1-92cd-72eab6214a2a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:29.230250 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-067de0ab-e433-48a1-92cd-72eab6214a2a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 200 len: 1682 microversion: 2.1 time: 0.154762 May 13 15:02:29.230826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 382/794] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:02:29 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:02:30.246634 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-897c897b-207a-4a30-87c1-6622929879bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:30.247249 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-897c897b-207a-4a30-87c1-6622929879bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:30.253692 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-897c897b-207a-4a30-87c1-6622929879bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:30.254124 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-897c897b-207a-4a30-87c1-6622929879bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:30.254923 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-897c897b-207a-4a30-87c1-6622929879bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:30.255355 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-897c897b-207a-4a30-87c1-6622929879bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:30.397355 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-897c897b-207a-4a30-87c1-6622929879bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:30.405474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-897c897b-207a-4a30-87c1-6622929879bb tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 200 len: 1682 microversion: 2.1 time: 0.162605 May 13 15:02:30.406496 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 413/795] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:02:30 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:02:30.932404 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-7c94eadc-a1f9-4c37-8af5-8338d5854785 req-76f63bb3-6b0f-41d6-b76a-0b1c874865bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf1ec1b0-5a88-48de-8329-bd0b9792b8d5", "name": "network-vif-deleted", "tag": "5a1e18eb-74a1-4afa-9947-0dc5d10cc4f0"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:02:30.945351 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-7c94eadc-a1f9-4c37-8af5-8338d5854785 req-76f63bb3-6b0f-41d6-b76a-0b1c874865bc service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:30.945930 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-7c94eadc-a1f9-4c37-8af5-8338d5854785 req-76f63bb3-6b0f-41d6-b76a-0b1c874865bc service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:30.958928 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-7c94eadc-a1f9-4c37-8af5-8338d5854785 req-76f63bb3-6b0f-41d6-b76a-0b1c874865bc service nova] Creating event network-vif-deleted:5a1e18eb-74a1-4afa-9947-0dc5d10cc4f0 for instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 on hv-cinder-83090 May 13 15:02:30.965401 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-7c94eadc-a1f9-4c37-8af5-8338d5854785 req-76f63bb3-6b0f-41d6-b76a-0b1c874865bc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036806 May 13 15:02:30.967069 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 383/796] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:02:31.423521 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-bb4ba276-7e17-4519-8073-569679413720 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:31.424278 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-bb4ba276-7e17-4519-8073-569679413720 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:31.431194 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bb4ba276-7e17-4519-8073-569679413720 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:31.431639 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bb4ba276-7e17-4519-8073-569679413720 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:31.432464 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bb4ba276-7e17-4519-8073-569679413720 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:31.433067 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bb4ba276-7e17-4519-8073-569679413720 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:31.466377 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bb4ba276-7e17-4519-8073-569679413720 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:31.466813 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bb4ba276-7e17-4519-8073-569679413720 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:31.467257 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-bb4ba276-7e17-4519-8073-569679413720 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lazy-loading 'fault' on Instance uuid cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:02:31.530768 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-bb4ba276-7e17-4519-8073-569679413720 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:31.547073 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-bb4ba276-7e17-4519-8073-569679413720 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 200 len: 1332 microversion: 2.1 time: 0.127894 May 13 15:02:31.548540 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 414/797] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:02:31 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 1332 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:02:32.565521 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c4b26e6e-19e7-466d-8675-7d403a81c965 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:32.566191 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c4b26e6e-19e7-466d-8675-7d403a81c965 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:32.573308 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c4b26e6e-19e7-466d-8675-7d403a81c965 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:32.574034 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c4b26e6e-19e7-466d-8675-7d403a81c965 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:32.574893 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c4b26e6e-19e7-466d-8675-7d403a81c965 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:32.575403 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c4b26e6e-19e7-466d-8675-7d403a81c965 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:32.588859 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-c4b26e6e-19e7-466d-8675-7d403a81c965 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] HTTP exception thrown: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c4b26e6e-19e7-466d-8675-7d403a81c965 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Request method failure captured: May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 HTTP/1.1 May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnETlq5ud0tLso0I4BZTgYxPV45uNUu133mcSZWQF8BrY5W-G7qjq44vNdtUOkhBY1NV_9YSUowwjJ-SwPRew__XdEJEaAD7-9rhSJZVxBqaksNyEovGIgePKTwhLV_b-Jq67lITHd9QMI2kWMsWgOPV6MBxPM4K-LIG_E6GaM8BRTg May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:02:32.590490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:02:32.592147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8ff6bdb0a99948698dc413c12b120b61", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:02:32.592147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:02:32.592147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:02:32.592147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:02:32.592147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:02:32.592147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:02:32.592147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:02:32.592147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: 1ded6e90b10949dcb921119073f2d26a May 13 15:02:32.592147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:02:32.592147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 15:02:32.592147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. May 13 15:02:32.592147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': 'cf1ec1b0-5a88-48de-8329-bd0b9792b8d5'} May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:02:32.596542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. May 13 15:02:32.598063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:02:32.600493 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c4b26e6e-19e7-466d-8675-7d403a81c965 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Returning 404 to user: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:02:32.600493 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c4b26e6e-19e7-466d-8675-7d403a81c965 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 404 len: 111 microversion: 2.1 time: 0.030658 May 13 15:02:32.600493 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 384/798] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:02:32 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:02:32.601174 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e9e58c74-0418-4779-b81d-b20c822098fe tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '.version_select at 0x7fcf4c9f0160>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:32.622993 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e9e58c74-0418-4779-b81d-b20c822098fe tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274671663" status: 202 len: 0 microversion: 2.1 time: 0.025748 May 13 15:02:32.623544 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 415/799] 10.222.0.99 () {58 vars in 1220 bytes} [Fri May 13 15:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274671663 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 15:02:33.251399 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-591ca5ce-1bae-4e60-ad8e-cefdb3146dc6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Action: 'create', calling method: .version_select at 0x7fcf4801bf70>, body: {"keypair": {"name": "tempest-keypair-1973660048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnCI+LrvEFn+42VSVESBUgYbnXHsRu3O+xAQrlQZEIKP+rDVHtPZ8kZPQejdr6Ifkw9RkOcxKpTtPp3WgvxwCAO0p4VDz47MRNX3YPRfpAShXG5xbU6LVYbthpmXwC6zA=="}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:02:33.265838 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-591ca5ce-1bae-4e60-ad8e-cefdb3146dc6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Getting quotas for project 8ff6bdb0a99948698dc413c12b120b61. Resources: {'key_pairs'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 15:02:33.269796 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-591ca5ce-1bae-4e60-ad8e-cefdb3146dc6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Getting quotas for user 1ded6e90b10949dcb921119073f2d26a and project 8ff6bdb0a99948698dc413c12b120b61. Resources: {'key_pairs'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 15:02:33.293112 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-591ca5ce-1bae-4e60-ad8e-cefdb3146dc6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046155 May 13 15:02:33.293712 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 385/800] 10.222.0.99 () {60 vars in 1158 bytes} [Fri May 13 15:02:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:02:34.898459 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-1036d5b3-3881-4255-8ce6-90b322686aa1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1530221548", "imageRef": "eac0bc7b-d963-4624-aba3-a81fd1bf324c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "316a8fad-500e-494b-ad63-b6f37981c2d9"}], "security_groups": [{"name": "tempest-securitygroup--209183624"}], "key_name": "tempest-keypair-1973660048", "user_data": "}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:02:35.003609 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.network.neutron [None req-1036d5b3-3881-4255-8ce6-90b322686aa1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] validate_networks() for [('316a8fad-500e-494b-ad63-b6f37981c2d9', None, None, None, None, None)] {{(pid=117295) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 15:02:35.402266 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-1036d5b3-3881-4255-8ce6-90b322686aa1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Flavor limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 15:02:35.402981 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-1036d5b3-3881-4255-8ce6-90b322686aa1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Image limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 15:02:35.403798 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-1036d5b3-3881-4255-8ce6-90b322686aa1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Flavor pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 15:02:35.404642 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-1036d5b3-3881-4255-8ce6-90b322686aa1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Image pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 15:02:35.405326 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-1036d5b3-3881-4255-8ce6-90b322686aa1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 15:02:35.418848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1036d5b3-3881-4255-8ce6-90b322686aa1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:35.419588 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1036d5b3-3881-4255-8ce6-90b322686aa1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:35.420976 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1036d5b3-3881-4255-8ce6-90b322686aa1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:35.421528 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1036d5b3-3881-4255-8ce6-90b322686aa1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:35.440735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-1036d5b3-3881-4255-8ce6-90b322686aa1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Getting quotas for project 8ff6bdb0a99948698dc413c12b120b61. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 15:02:35.445415 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-1036d5b3-3881-4255-8ce6-90b322686aa1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Getting quotas for user 1ded6e90b10949dcb921119073f2d26a and project 8ff6bdb0a99948698dc413c12b120b61. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 15:02:35.458356 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-1036d5b3-3881-4255-8ce6-90b322686aa1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Going to run 1 instances... {{(pid=117295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 15:02:35.460710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-1036d5b3-3881-4255-8ce6-90b322686aa1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac0bc7b-d963-4624-aba3-a81fd1bf324c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 15:02:35.515475 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-1036d5b3-3881-4255-8ce6-90b322686aa1 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.621908 May 13 15:02:35.516172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 416/801] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 15:02:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 15:02:35.526888 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b627a03a-b63f-4b14-9e59-1a976b9e4aca tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:35.527509 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b627a03a-b63f-4b14-9e59-1a976b9e4aca tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:35.582367 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b627a03a-b63f-4b14-9e59-1a976b9e4aca tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:35.590805 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b627a03a-b63f-4b14-9e59-1a976b9e4aca tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 200 len: 1242 microversion: 2.1 time: 0.068241 May 13 15:02:35.591452 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 386/802] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:02:35 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:02:36.609246 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-1badc842-9426-4033-9198-e929356db949 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:36.610479 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-1badc842-9426-4033-9198-e929356db949 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:36.617938 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1badc842-9426-4033-9198-e929356db949 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:36.618654 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1badc842-9426-4033-9198-e929356db949 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:36.620282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1badc842-9426-4033-9198-e929356db949 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:36.620908 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1badc842-9426-4033-9198-e929356db949 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:36.696145 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-1badc842-9426-4033-9198-e929356db949 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:36.705629 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-1badc842-9426-4033-9198-e929356db949 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 200 len: 1302 microversion: 2.1 time: 0.100805 May 13 15:02:36.707005 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 417/803] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:02:36 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:02:37.723903 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-2a58c8ec-b25d-4927-953d-eb4389211f46 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:37.724642 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-2a58c8ec-b25d-4927-953d-eb4389211f46 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:37.731764 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2a58c8ec-b25d-4927-953d-eb4389211f46 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:37.732232 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2a58c8ec-b25d-4927-953d-eb4389211f46 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:37.733006 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2a58c8ec-b25d-4927-953d-eb4389211f46 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:37.733433 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2a58c8ec-b25d-4927-953d-eb4389211f46 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:37.862990 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-2a58c8ec-b25d-4927-953d-eb4389211f46 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:37.871397 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-2a58c8ec-b25d-4927-953d-eb4389211f46 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 200 len: 1367 microversion: 2.1 time: 0.151360 May 13 15:02:37.872000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 387/804] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:02:37 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:02:38.144067 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-d4b6cec3-e769-4fba-9c38-66f1ec7d6007 req-ff519f07-d9fd-4105-8876-2fdcb11d5bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0ebb1ba-c437-4742-be14-49a16452e618", "tag": "913713f9-227c-453c-8a43-d81597fa8d48"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:02:38.154682 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-d4b6cec3-e769-4fba-9c38-66f1ec7d6007 req-ff519f07-d9fd-4105-8876-2fdcb11d5bf2 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:38.156299 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-d4b6cec3-e769-4fba-9c38-66f1ec7d6007 req-ff519f07-d9fd-4105-8876-2fdcb11d5bf2 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:38.171231 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-d4b6cec3-e769-4fba-9c38-66f1ec7d6007 req-ff519f07-d9fd-4105-8876-2fdcb11d5bf2 service nova] Creating event network-changed:913713f9-227c-453c-8a43-d81597fa8d48 for instance d0ebb1ba-c437-4742-be14-49a16452e618 on hv-cinder-83090 May 13 15:02:38.178355 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-d4b6cec3-e769-4fba-9c38-66f1ec7d6007 req-ff519f07-d9fd-4105-8876-2fdcb11d5bf2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040913 May 13 15:02:38.178973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 418/805] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:02:38.892265 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-67ac39d0-5ee5-4554-b5a4-baab6735510c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:38.893263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-67ac39d0-5ee5-4554-b5a4-baab6735510c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:38.904113 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-67ac39d0-5ee5-4554-b5a4-baab6735510c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:38.904873 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-67ac39d0-5ee5-4554-b5a4-baab6735510c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:38.906180 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-67ac39d0-5ee5-4554-b5a4-baab6735510c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:38.906899 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-67ac39d0-5ee5-4554-b5a4-baab6735510c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:39.052185 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-67ac39d0-5ee5-4554-b5a4-baab6735510c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:39.060177 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-67ac39d0-5ee5-4554-b5a4-baab6735510c tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 200 len: 1367 microversion: 2.1 time: 0.174384 May 13 15:02:39.060747 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 388/806] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:02:38 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:02:40.078590 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-188f1919-47d3-43ab-bddc-71d07e5a0d9f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:40.079433 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-188f1919-47d3-43ab-bddc-71d07e5a0d9f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:40.086714 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-188f1919-47d3-43ab-bddc-71d07e5a0d9f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:40.087170 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-188f1919-47d3-43ab-bddc-71d07e5a0d9f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:40.087979 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-188f1919-47d3-43ab-bddc-71d07e5a0d9f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:40.088409 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-188f1919-47d3-43ab-bddc-71d07e5a0d9f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:40.236294 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-188f1919-47d3-43ab-bddc-71d07e5a0d9f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:40.246659 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-188f1919-47d3-43ab-bddc-71d07e5a0d9f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 200 len: 1367 microversion: 2.1 time: 0.172434 May 13 15:02:40.247229 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 419/807] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:02:40 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:02:41.265254 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ff1e4ab7-9efc-47af-8795-6406db7091ff tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:41.266012 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ff1e4ab7-9efc-47af-8795-6406db7091ff tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:41.273055 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ff1e4ab7-9efc-47af-8795-6406db7091ff tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:41.273607 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ff1e4ab7-9efc-47af-8795-6406db7091ff tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:41.274297 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ff1e4ab7-9efc-47af-8795-6406db7091ff tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:41.274763 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ff1e4ab7-9efc-47af-8795-6406db7091ff tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:41.408952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ff1e4ab7-9efc-47af-8795-6406db7091ff tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:41.416821 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ff1e4ab7-9efc-47af-8795-6406db7091ff tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 200 len: 1367 microversion: 2.1 time: 0.156401 May 13 15:02:41.417386 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 389/808] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:02:41 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:02:42.444728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-b44a2d8d-9074-4133-ae3c-d2e2451dd615 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:42.446027 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-b44a2d8d-9074-4133-ae3c-d2e2451dd615 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:42.453229 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b44a2d8d-9074-4133-ae3c-d2e2451dd615 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:42.453683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b44a2d8d-9074-4133-ae3c-d2e2451dd615 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:42.454460 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b44a2d8d-9074-4133-ae3c-d2e2451dd615 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:42.454902 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b44a2d8d-9074-4133-ae3c-d2e2451dd615 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:42.604900 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b44a2d8d-9074-4133-ae3c-d2e2451dd615 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:42.616739 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-b44a2d8d-9074-4133-ae3c-d2e2451dd615 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 200 len: 1367 microversion: 2.1 time: 0.180563 May 13 15:02:42.617503 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 420/809] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:02:42 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:02:43.638296 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-51c251a0-2983-4ebf-9c7e-17d1d7e85f1f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:43.639281 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-51c251a0-2983-4ebf-9c7e-17d1d7e85f1f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:43.649706 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-51c251a0-2983-4ebf-9c7e-17d1d7e85f1f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:43.650152 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-51c251a0-2983-4ebf-9c7e-17d1d7e85f1f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:43.650921 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-51c251a0-2983-4ebf-9c7e-17d1d7e85f1f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:43.651352 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-51c251a0-2983-4ebf-9c7e-17d1d7e85f1f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:43.805989 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-51c251a0-2983-4ebf-9c7e-17d1d7e85f1f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:43.813344 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-51c251a0-2983-4ebf-9c7e-17d1d7e85f1f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 200 len: 1367 microversion: 2.1 time: 0.181851 May 13 15:02:43.813937 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 390/810] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:02:43 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:02:44.833608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-305e3eb9-f910-4a94-9406-ac98f22fbc5f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:44.834634 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-305e3eb9-f910-4a94-9406-ac98f22fbc5f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:44.846264 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-305e3eb9-f910-4a94-9406-ac98f22fbc5f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:44.847106 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-305e3eb9-f910-4a94-9406-ac98f22fbc5f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:44.848528 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-305e3eb9-f910-4a94-9406-ac98f22fbc5f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:44.849384 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-305e3eb9-f910-4a94-9406-ac98f22fbc5f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:44.989243 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-305e3eb9-f910-4a94-9406-ac98f22fbc5f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:44.998337 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-305e3eb9-f910-4a94-9406-ac98f22fbc5f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 200 len: 1367 microversion: 2.1 time: 0.171157 May 13 15:02:44.998990 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 421/811] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:02:44 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:02:46.017334 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5f28cf92-46c2-49c2-8233-fda5d9fae4b4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:46.018133 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5f28cf92-46c2-49c2-8233-fda5d9fae4b4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:46.024658 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5f28cf92-46c2-49c2-8233-fda5d9fae4b4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:46.025120 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5f28cf92-46c2-49c2-8233-fda5d9fae4b4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:46.025897 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5f28cf92-46c2-49c2-8233-fda5d9fae4b4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:46.026328 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5f28cf92-46c2-49c2-8233-fda5d9fae4b4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:46.136158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-d45e5503-13d3-40e0-b13f-cc3d8d2971b7 req-d52fccb5-a2d4-44a4-a149-b5134519f0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ebb1ba-c437-4742-be14-49a16452e618", "name": "network-vif-plugged", "status": "completed", "tag": "913713f9-227c-453c-8a43-d81597fa8d48"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:02:46.144923 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-d45e5503-13d3-40e0-b13f-cc3d8d2971b7 req-d52fccb5-a2d4-44a4-a149-b5134519f0a0 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:46.145322 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-d45e5503-13d3-40e0-b13f-cc3d8d2971b7 req-d52fccb5-a2d4-44a4-a149-b5134519f0a0 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:46.160027 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-d45e5503-13d3-40e0-b13f-cc3d8d2971b7 req-d52fccb5-a2d4-44a4-a149-b5134519f0a0 service nova] Creating event network-vif-plugged:913713f9-227c-453c-8a43-d81597fa8d48 for instance d0ebb1ba-c437-4742-be14-49a16452e618 on hv-cinder-83090 May 13 15:02:46.165603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-d45e5503-13d3-40e0-b13f-cc3d8d2971b7 req-d52fccb5-a2d4-44a4-a149-b5134519f0a0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033164 May 13 15:02:46.166018 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 422/812] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:02:46.179300 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5f28cf92-46c2-49c2-8233-fda5d9fae4b4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:46.186673 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5f28cf92-46c2-49c2-8233-fda5d9fae4b4 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 200 len: 1367 microversion: 2.1 time: 0.173347 May 13 15:02:46.187240 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 391/813] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:02:46 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:02:47.208264 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ded9b8ee-6277-4949-bc4f-ceb1e6e8ae26 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:47.209391 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ded9b8ee-6277-4949-bc4f-ceb1e6e8ae26 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:47.217293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ded9b8ee-6277-4949-bc4f-ceb1e6e8ae26 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:47.217733 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ded9b8ee-6277-4949-bc4f-ceb1e6e8ae26 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:47.218527 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ded9b8ee-6277-4949-bc4f-ceb1e6e8ae26 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:47.218952 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ded9b8ee-6277-4949-bc4f-ceb1e6e8ae26 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:47.360389 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ded9b8ee-6277-4949-bc4f-ceb1e6e8ae26 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:47.368113 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ded9b8ee-6277-4949-bc4f-ceb1e6e8ae26 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 200 len: 1367 microversion: 2.1 time: 0.167507 May 13 15:02:47.368673 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 423/814] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:02:47 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:02:48.389558 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-75eb498b-cfcf-44cd-b6c2-745cd84ea8e6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:48.390520 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-75eb498b-cfcf-44cd-b6c2-745cd84ea8e6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:48.402135 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-75eb498b-cfcf-44cd-b6c2-745cd84ea8e6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:48.402888 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-75eb498b-cfcf-44cd-b6c2-745cd84ea8e6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:48.404237 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-75eb498b-cfcf-44cd-b6c2-745cd84ea8e6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:48.404933 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-75eb498b-cfcf-44cd-b6c2-745cd84ea8e6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:48.550186 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-75eb498b-cfcf-44cd-b6c2-745cd84ea8e6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:48.558803 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-75eb498b-cfcf-44cd-b6c2-745cd84ea8e6 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 200 len: 1557 microversion: 2.1 time: 0.176304 May 13 15:02:48.559378 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 392/815] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:02:48 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:02:48.575851 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f2240c41-71d7-49ae-be88-2e1189f653ad tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:48.576415 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f2240c41-71d7-49ae-be88-2e1189f653ad tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:48.583027 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f2240c41-71d7-49ae-be88-2e1189f653ad tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:48.583532 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f2240c41-71d7-49ae-be88-2e1189f653ad tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:48.584320 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f2240c41-71d7-49ae-be88-2e1189f653ad tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:48.584789 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f2240c41-71d7-49ae-be88-2e1189f653ad tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:48.670889 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f2240c41-71d7-49ae-be88-2e1189f653ad tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099557 May 13 15:02:48.671494 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 424/816] 10.222.0.99 () {58 vars in 1274 bytes} [Fri May 13 15:02:48 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:02:49.970143 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-b01e1728-866e-45e8-8331-ceb95b69dd30 req-a1fd62ee-7661-4246-a632-7cb2d830fab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0ebb1ba-c437-4742-be14-49a16452e618", "tag": "913713f9-227c-453c-8a43-d81597fa8d48"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:02:49.979778 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-b01e1728-866e-45e8-8331-ceb95b69dd30 req-a1fd62ee-7661-4246-a632-7cb2d830fab6 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:49.980257 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-b01e1728-866e-45e8-8331-ceb95b69dd30 req-a1fd62ee-7661-4246-a632-7cb2d830fab6 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:49.992197 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-b01e1728-866e-45e8-8331-ceb95b69dd30 req-a1fd62ee-7661-4246-a632-7cb2d830fab6 service nova] Creating event network-changed:913713f9-227c-453c-8a43-d81597fa8d48 for instance d0ebb1ba-c437-4742-be14-49a16452e618 on hv-cinder-83090 May 13 15:02:49.998489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-b01e1728-866e-45e8-8331-ceb95b69dd30 req-a1fd62ee-7661-4246-a632-7cb2d830fab6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032009 May 13 15:02:49.999466 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 393/817] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:02:51.545944 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-2a670f62-f1aa-4e48-8892-2f57d72acf25 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:51.546490 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-2a670f62-f1aa-4e48-8892-2f57d72acf25 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:51.553001 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2a670f62-f1aa-4e48-8892-2f57d72acf25 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:51.553458 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2a670f62-f1aa-4e48-8892-2f57d72acf25 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:51.554232 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2a670f62-f1aa-4e48-8892-2f57d72acf25 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:51.554661 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2a670f62-f1aa-4e48-8892-2f57d72acf25 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:51.580945 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-2a670f62-f1aa-4e48-8892-2f57d72acf25 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894/ips" status: 200 len: 152 microversion: 2.20 time: 0.039237 May 13 15:02:51.581742 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 425/818] 10.222.0.99 () {60 vars in 1288 bytes} [Fri May 13 15:02:51 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 15:02:53.369973 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-489c9494-f015-40d3-9139-034ce9234151 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:02:53.370678 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-489c9494-f015-40d3-9139-034ce9234151 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:53.377306 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-489c9494-f015-40d3-9139-034ce9234151 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:53.377755 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-489c9494-f015-40d3-9139-034ce9234151 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:53.378527 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-489c9494-f015-40d3-9139-034ce9234151 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:53.378964 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-489c9494-f015-40d3-9139-034ce9234151 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:53.403385 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-489c9494-f015-40d3-9139-034ce9234151 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lazy-loading 'flavor' on Instance uuid 7d326e41-aedb-47b1-bf2f-e7784d3d4894 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:02:53.680848 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-489c9494-f015-40d3-9139-034ce9234151 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "POST /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894/action" status: 202 len: 0 microversion: 2.20 time: 0.318297 May 13 15:02:53.681631 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 394/819] 10.222.0.99 () {62 vars in 1318 bytes} [Fri May 13 15:02:53 2022] POST /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 15:02:53.689754 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-503c326e-b7a4-4e51-aa58-db8d14b1bcc0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:53.690434 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-503c326e-b7a4-4e51-aa58-db8d14b1bcc0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:53.697282 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-503c326e-b7a4-4e51-aa58-db8d14b1bcc0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:53.697772 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-503c326e-b7a4-4e51-aa58-db8d14b1bcc0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:53.698821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-503c326e-b7a4-4e51-aa58-db8d14b1bcc0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:53.699433 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-503c326e-b7a4-4e51-aa58-db8d14b1bcc0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:53.831775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-503c326e-b7a4-4e51-aa58-db8d14b1bcc0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:53.840878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-503c326e-b7a4-4e51-aa58-db8d14b1bcc0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:53.842351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-503c326e-b7a4-4e51-aa58-db8d14b1bcc0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:53.843513 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-503c326e-b7a4-4e51-aa58-db8d14b1bcc0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1724 microversion: 2.20 time: 0.157653 May 13 15:02:53.844111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 426/820] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:02:53 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:02:54.868643 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-dcc86141-23bb-4d18-a604-dbb1548d3a5d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:54.869834 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-dcc86141-23bb-4d18-a604-dbb1548d3a5d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:54.876723 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dcc86141-23bb-4d18-a604-dbb1548d3a5d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:54.877186 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dcc86141-23bb-4d18-a604-dbb1548d3a5d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:54.877931 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dcc86141-23bb-4d18-a604-dbb1548d3a5d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:54.878358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dcc86141-23bb-4d18-a604-dbb1548d3a5d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:55.019668 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-dcc86141-23bb-4d18-a604-dbb1548d3a5d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:55.028338 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-dcc86141-23bb-4d18-a604-dbb1548d3a5d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:55.029815 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-dcc86141-23bb-4d18-a604-dbb1548d3a5d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:55.030986 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-dcc86141-23bb-4d18-a604-dbb1548d3a5d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1724 microversion: 2.20 time: 0.170257 May 13 15:02:55.031539 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 395/821] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:02:54 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:02:56.049732 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e331c18b-95f3-45e0-b667-9e1edf8c51d7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:56.050345 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e331c18b-95f3-45e0-b667-9e1edf8c51d7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:56.057166 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e331c18b-95f3-45e0-b667-9e1edf8c51d7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:56.057621 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e331c18b-95f3-45e0-b667-9e1edf8c51d7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:56.058517 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e331c18b-95f3-45e0-b667-9e1edf8c51d7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:56.059396 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e331c18b-95f3-45e0-b667-9e1edf8c51d7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:56.215937 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e331c18b-95f3-45e0-b667-9e1edf8c51d7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:56.224316 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e331c18b-95f3-45e0-b667-9e1edf8c51d7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:56.225824 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e331c18b-95f3-45e0-b667-9e1edf8c51d7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:56.227013 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e331c18b-95f3-45e0-b667-9e1edf8c51d7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1724 microversion: 2.20 time: 0.181274 May 13 15:02:56.227932 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 427/822] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:02:56 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:02:57.249983 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-4186745a-7bb4-4254-96a9-9d79a00c0904 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:57.251008 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-4186745a-7bb4-4254-96a9-9d79a00c0904 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:57.261668 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4186745a-7bb4-4254-96a9-9d79a00c0904 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:57.262110 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4186745a-7bb4-4254-96a9-9d79a00c0904 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:57.262897 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4186745a-7bb4-4254-96a9-9d79a00c0904 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:57.263326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4186745a-7bb4-4254-96a9-9d79a00c0904 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:57.407684 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-4186745a-7bb4-4254-96a9-9d79a00c0904 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:57.419437 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-4186745a-7bb4-4254-96a9-9d79a00c0904 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:57.420966 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-4186745a-7bb4-4254-96a9-9d79a00c0904 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:57.422132 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-4186745a-7bb4-4254-96a9-9d79a00c0904 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1724 microversion: 2.20 time: 0.178651 May 13 15:02:57.422696 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 396/823] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:02:57 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:02:58.440605 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c2918313-c7e2-4a2e-bf89-75d789e3b6f3 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:58.441167 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c2918313-c7e2-4a2e-bf89-75d789e3b6f3 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:58.448413 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c2918313-c7e2-4a2e-bf89-75d789e3b6f3 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:58.449081 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c2918313-c7e2-4a2e-bf89-75d789e3b6f3 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:58.450015 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c2918313-c7e2-4a2e-bf89-75d789e3b6f3 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:58.450492 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c2918313-c7e2-4a2e-bf89-75d789e3b6f3 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:58.589284 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c2918313-c7e2-4a2e-bf89-75d789e3b6f3 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:58.597570 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c2918313-c7e2-4a2e-bf89-75d789e3b6f3 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:58.599028 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c2918313-c7e2-4a2e-bf89-75d789e3b6f3 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:58.600307 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c2918313-c7e2-4a2e-bf89-75d789e3b6f3 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1724 microversion: 2.20 time: 0.163556 May 13 15:02:58.600882 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 428/824] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:02:58 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:02:59.621928 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-95782930-961c-4244-aa41-a4d5c625fcd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:02:59.622799 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-95782930-961c-4244-aa41-a4d5c625fcd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:02:59.632683 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-95782930-961c-4244-aa41-a4d5c625fcd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:59.633350 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-95782930-961c-4244-aa41-a4d5c625fcd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:59.634573 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-95782930-961c-4244-aa41-a4d5c625fcd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:02:59.635187 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-95782930-961c-4244-aa41-a4d5c625fcd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:02:59.789554 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-95782930-961c-4244-aa41-a4d5c625fcd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:59.797540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-95782930-961c-4244-aa41-a4d5c625fcd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:59.799008 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-95782930-961c-4244-aa41-a4d5c625fcd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:02:59.800191 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-95782930-961c-4244-aa41-a4d5c625fcd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1724 microversion: 2.20 time: 0.184502 May 13 15:02:59.800757 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 397/825] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:02:59 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:00.822807 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-16f2e08d-cfe1-4ae9-b1fd-27f04fa2e57d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:00.824273 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-16f2e08d-cfe1-4ae9-b1fd-27f04fa2e57d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:00.834463 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-16f2e08d-cfe1-4ae9-b1fd-27f04fa2e57d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:00.835213 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-16f2e08d-cfe1-4ae9-b1fd-27f04fa2e57d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:00.836542 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-16f2e08d-cfe1-4ae9-b1fd-27f04fa2e57d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:00.837274 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-16f2e08d-cfe1-4ae9-b1fd-27f04fa2e57d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:00.986561 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-16f2e08d-cfe1-4ae9-b1fd-27f04fa2e57d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:00.995135 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-16f2e08d-cfe1-4ae9-b1fd-27f04fa2e57d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:00.996636 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-16f2e08d-cfe1-4ae9-b1fd-27f04fa2e57d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:00.997801 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-16f2e08d-cfe1-4ae9-b1fd-27f04fa2e57d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1724 microversion: 2.20 time: 0.181640 May 13 15:03:00.998505 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 429/826] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:00 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:02.017283 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c5fd1011-942f-47ba-aee8-ad0acd140ecd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:02.017874 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c5fd1011-942f-47ba-aee8-ad0acd140ecd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:02.024496 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c5fd1011-942f-47ba-aee8-ad0acd140ecd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:02.024949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c5fd1011-942f-47ba-aee8-ad0acd140ecd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:02.025694 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c5fd1011-942f-47ba-aee8-ad0acd140ecd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:02.026119 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c5fd1011-942f-47ba-aee8-ad0acd140ecd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:02.168256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c5fd1011-942f-47ba-aee8-ad0acd140ecd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:02.177850 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c5fd1011-942f-47ba-aee8-ad0acd140ecd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:02.179339 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c5fd1011-942f-47ba-aee8-ad0acd140ecd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:02.180565 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c5fd1011-942f-47ba-aee8-ad0acd140ecd tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1724 microversion: 2.20 time: 0.167182 May 13 15:03:02.181126 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 398/827] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:02 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:03.198737 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-8733842b-a17e-4b48-b15a-ce4e86259bfc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:03.199390 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-8733842b-a17e-4b48-b15a-ce4e86259bfc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:03.206322 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8733842b-a17e-4b48-b15a-ce4e86259bfc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:03.206763 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8733842b-a17e-4b48-b15a-ce4e86259bfc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:03.207509 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8733842b-a17e-4b48-b15a-ce4e86259bfc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:03.207980 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8733842b-a17e-4b48-b15a-ce4e86259bfc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:03.339376 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-8733842b-a17e-4b48-b15a-ce4e86259bfc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:03.347934 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-8733842b-a17e-4b48-b15a-ce4e86259bfc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:03.349449 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-8733842b-a17e-4b48-b15a-ce4e86259bfc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:03.350686 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-8733842b-a17e-4b48-b15a-ce4e86259bfc tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1724 microversion: 2.20 time: 0.155851 May 13 15:03:03.351220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 430/828] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:03 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:04.372443 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8f09c920-fe17-4e0e-887a-63fc83945f63 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:04.373070 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8f09c920-fe17-4e0e-887a-63fc83945f63 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:04.379914 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f09c920-fe17-4e0e-887a-63fc83945f63 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:04.380395 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f09c920-fe17-4e0e-887a-63fc83945f63 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:04.381175 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f09c920-fe17-4e0e-887a-63fc83945f63 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:04.381613 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f09c920-fe17-4e0e-887a-63fc83945f63 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:04.511231 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8f09c920-fe17-4e0e-887a-63fc83945f63 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:04.519303 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8f09c920-fe17-4e0e-887a-63fc83945f63 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:04.520833 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8f09c920-fe17-4e0e-887a-63fc83945f63 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:04.522008 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8f09c920-fe17-4e0e-887a-63fc83945f63 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1724 microversion: 2.20 time: 0.155233 May 13 15:03:04.522583 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 399/829] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:04 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:05.541145 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-948d7769-026b-4549-9829-c2420f56f45c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:05.541753 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-948d7769-026b-4549-9829-c2420f56f45c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:05.551207 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-948d7769-026b-4549-9829-c2420f56f45c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:05.551854 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-948d7769-026b-4549-9829-c2420f56f45c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:05.552839 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-948d7769-026b-4549-9829-c2420f56f45c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:05.553268 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-948d7769-026b-4549-9829-c2420f56f45c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:05.701668 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-948d7769-026b-4549-9829-c2420f56f45c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:05.710091 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-948d7769-026b-4549-9829-c2420f56f45c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:05.711574 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-948d7769-026b-4549-9829-c2420f56f45c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:05.712770 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-948d7769-026b-4549-9829-c2420f56f45c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1745 microversion: 2.20 time: 0.175713 May 13 15:03:05.713339 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 431/830] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:05 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:06.736230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-662a3ee6-b231-430a-95cc-615522fc1c8a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:06.737186 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-662a3ee6-b231-430a-95cc-615522fc1c8a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:06.747627 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-662a3ee6-b231-430a-95cc-615522fc1c8a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:06.748107 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-662a3ee6-b231-430a-95cc-615522fc1c8a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:06.748876 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-662a3ee6-b231-430a-95cc-615522fc1c8a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:06.749307 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-662a3ee6-b231-430a-95cc-615522fc1c8a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:06.894963 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-662a3ee6-b231-430a-95cc-615522fc1c8a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:06.902811 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-662a3ee6-b231-430a-95cc-615522fc1c8a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:06.904513 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-662a3ee6-b231-430a-95cc-615522fc1c8a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:06.905671 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-662a3ee6-b231-430a-95cc-615522fc1c8a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1745 microversion: 2.20 time: 0.176247 May 13 15:03:06.906232 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 400/831] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:06 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1745 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:07.928591 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-516bd562-12f6-40fb-9d87-579f429128cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:07.929457 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-516bd562-12f6-40fb-9d87-579f429128cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:07.938897 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-516bd562-12f6-40fb-9d87-579f429128cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:07.939350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-516bd562-12f6-40fb-9d87-579f429128cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:07.940169 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-516bd562-12f6-40fb-9d87-579f429128cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:07.940629 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-516bd562-12f6-40fb-9d87-579f429128cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:08.102952 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-516bd562-12f6-40fb-9d87-579f429128cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:08.111854 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-516bd562-12f6-40fb-9d87-579f429128cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:08.113422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-516bd562-12f6-40fb-9d87-579f429128cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:08.114620 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-516bd562-12f6-40fb-9d87-579f429128cf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1745 microversion: 2.20 time: 0.192729 May 13 15:03:08.115186 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 432/832] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:07 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1745 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:09.137834 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-daa74cce-170d-4b4e-8bdc-4297aa77f1aa tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:09.138780 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-daa74cce-170d-4b4e-8bdc-4297aa77f1aa tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:09.145938 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-daa74cce-170d-4b4e-8bdc-4297aa77f1aa tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:09.146385 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-daa74cce-170d-4b4e-8bdc-4297aa77f1aa tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:09.147139 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-daa74cce-170d-4b4e-8bdc-4297aa77f1aa tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:09.147565 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-daa74cce-170d-4b4e-8bdc-4297aa77f1aa tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:09.291216 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-daa74cce-170d-4b4e-8bdc-4297aa77f1aa tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:09.299802 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-daa74cce-170d-4b4e-8bdc-4297aa77f1aa tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:09.301331 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-daa74cce-170d-4b4e-8bdc-4297aa77f1aa tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:09.302570 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-daa74cce-170d-4b4e-8bdc-4297aa77f1aa tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1745 microversion: 2.20 time: 0.171316 May 13 15:03:09.303140 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 401/833] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:09 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:10.237568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-edc76782-f5b4-45f4-94d3-ec0bb25c5f21 req-954ee05f-221b-4eca-b429-da1908ab5d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d326e41-aedb-47b1-bf2f-e7784d3d4894", "name": "network-vif-plugged", "status": "completed", "tag": "31bf981e-aa80-4a0b-a642-84d2bded56aa"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:03:10.247354 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-edc76782-f5b4-45f4-94d3-ec0bb25c5f21 req-954ee05f-221b-4eca-b429-da1908ab5d75 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:10.247715 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-edc76782-f5b4-45f4-94d3-ec0bb25c5f21 req-954ee05f-221b-4eca-b429-da1908ab5d75 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:10.259601 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-edc76782-f5b4-45f4-94d3-ec0bb25c5f21 req-954ee05f-221b-4eca-b429-da1908ab5d75 service nova] Creating event network-vif-plugged:31bf981e-aa80-4a0b-a642-84d2bded56aa for instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 on hv-cinder-83090 May 13 15:03:10.264730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-edc76782-f5b4-45f4-94d3-ec0bb25c5f21 req-954ee05f-221b-4eca-b429-da1908ab5d75 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031542 May 13 15:03:10.265294 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 433/834] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:03:10.322328 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1d0b30d6-b017-4b62-a7be-1a1f50f863d0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:10.322837 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1d0b30d6-b017-4b62-a7be-1a1f50f863d0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:10.329631 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1d0b30d6-b017-4b62-a7be-1a1f50f863d0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:10.330086 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1d0b30d6-b017-4b62-a7be-1a1f50f863d0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:10.330850 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1d0b30d6-b017-4b62-a7be-1a1f50f863d0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:10.331280 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1d0b30d6-b017-4b62-a7be-1a1f50f863d0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:10.467031 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1d0b30d6-b017-4b62-a7be-1a1f50f863d0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:10.476593 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1d0b30d6-b017-4b62-a7be-1a1f50f863d0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:10.478422 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1d0b30d6-b017-4b62-a7be-1a1f50f863d0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:10.479620 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1d0b30d6-b017-4b62-a7be-1a1f50f863d0 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1745 microversion: 2.20 time: 0.161470 May 13 15:03:10.480250 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 402/835] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:10 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:11.499234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f414a1aa-d89f-44e3-be29-d432fd84c47f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:11.499999 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f414a1aa-d89f-44e3-be29-d432fd84c47f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:11.506406 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f414a1aa-d89f-44e3-be29-d432fd84c47f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:11.506854 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f414a1aa-d89f-44e3-be29-d432fd84c47f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:11.507823 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f414a1aa-d89f-44e3-be29-d432fd84c47f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:11.508383 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f414a1aa-d89f-44e3-be29-d432fd84c47f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:11.641269 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f414a1aa-d89f-44e3-be29-d432fd84c47f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:11.650463 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f414a1aa-d89f-44e3-be29-d432fd84c47f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:11.652450 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f414a1aa-d89f-44e3-be29-d432fd84c47f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:11.653802 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f414a1aa-d89f-44e3-be29-d432fd84c47f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1740 microversion: 2.20 time: 0.159193 May 13 15:03:11.654675 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 434/836] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:11 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:12.675773 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8457f11d-eccc-498c-b8b8-91aaac39fb66 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:12.676409 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8457f11d-eccc-498c-b8b8-91aaac39fb66 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:12.683189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8457f11d-eccc-498c-b8b8-91aaac39fb66 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:12.684062 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8457f11d-eccc-498c-b8b8-91aaac39fb66 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:12.684841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8457f11d-eccc-498c-b8b8-91aaac39fb66 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:12.685321 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8457f11d-eccc-498c-b8b8-91aaac39fb66 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:12.836450 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8457f11d-eccc-498c-b8b8-91aaac39fb66 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:12.848312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8457f11d-eccc-498c-b8b8-91aaac39fb66 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:12.850035 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8457f11d-eccc-498c-b8b8-91aaac39fb66 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:12.851357 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8457f11d-eccc-498c-b8b8-91aaac39fb66 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1740 microversion: 2.20 time: 0.179550 May 13 15:03:12.852962 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 403/837] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:12 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:13.870374 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-8302a7a0-8d15-46e5-bc87-bac0e6ab2601 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:13.870918 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-8302a7a0-8d15-46e5-bc87-bac0e6ab2601 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:13.878158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8302a7a0-8d15-46e5-bc87-bac0e6ab2601 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:13.878937 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8302a7a0-8d15-46e5-bc87-bac0e6ab2601 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:13.879788 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8302a7a0-8d15-46e5-bc87-bac0e6ab2601 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:13.880333 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8302a7a0-8d15-46e5-bc87-bac0e6ab2601 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:14.027784 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-8302a7a0-8d15-46e5-bc87-bac0e6ab2601 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:14.044131 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-8302a7a0-8d15-46e5-bc87-bac0e6ab2601 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:14.045626 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-8302a7a0-8d15-46e5-bc87-bac0e6ab2601 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:14.047472 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-8302a7a0-8d15-46e5-bc87-bac0e6ab2601 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1740 microversion: 2.20 time: 0.180532 May 13 15:03:14.048332 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 435/838] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:13 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:15.067656 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5a801944-c8b9-441f-9da9-1d2008deb4c1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:15.068368 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5a801944-c8b9-441f-9da9-1d2008deb4c1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:15.075163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5a801944-c8b9-441f-9da9-1d2008deb4c1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:15.075613 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5a801944-c8b9-441f-9da9-1d2008deb4c1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:15.076442 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5a801944-c8b9-441f-9da9-1d2008deb4c1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:15.076868 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5a801944-c8b9-441f-9da9-1d2008deb4c1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:15.224038 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5a801944-c8b9-441f-9da9-1d2008deb4c1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:15.233225 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5a801944-c8b9-441f-9da9-1d2008deb4c1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:15.234712 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5a801944-c8b9-441f-9da9-1d2008deb4c1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:15.236123 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5a801944-c8b9-441f-9da9-1d2008deb4c1 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1740 microversion: 2.20 time: 0.172664 May 13 15:03:15.236819 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 404/839] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:15 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:16.256395 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-7d00900a-d51b-4bbb-b352-6665544badd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:16.257016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-7d00900a-d51b-4bbb-b352-6665544badd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:16.263987 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7d00900a-d51b-4bbb-b352-6665544badd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:16.264534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7d00900a-d51b-4bbb-b352-6665544badd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:16.265386 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7d00900a-d51b-4bbb-b352-6665544badd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:16.265913 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7d00900a-d51b-4bbb-b352-6665544badd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:16.413680 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-7d00900a-d51b-4bbb-b352-6665544badd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:16.422243 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-7d00900a-d51b-4bbb-b352-6665544badd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:16.423911 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-7d00900a-d51b-4bbb-b352-6665544badd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:16.425269 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-7d00900a-d51b-4bbb-b352-6665544badd6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1740 microversion: 2.20 time: 0.173818 May 13 15:03:16.434056 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 436/840] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:16 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:17.444796 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-60893c0a-1fc7-4087-bbf1-75ed0355c53f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:17.445500 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-60893c0a-1fc7-4087-bbf1-75ed0355c53f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:17.453499 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-60893c0a-1fc7-4087-bbf1-75ed0355c53f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:17.453952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-60893c0a-1fc7-4087-bbf1-75ed0355c53f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:17.454715 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-60893c0a-1fc7-4087-bbf1-75ed0355c53f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:17.455149 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-60893c0a-1fc7-4087-bbf1-75ed0355c53f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:17.597127 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c9cffc3f-c886-4cd0-979f-46dba42275d9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:17.599260 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c9cffc3f-c886-4cd0-979f-46dba42275d9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:17.615328 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c9cffc3f-c886-4cd0-979f-46dba42275d9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:17.615893 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c9cffc3f-c886-4cd0-979f-46dba42275d9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:17.619153 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c9cffc3f-c886-4cd0-979f-46dba42275d9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:17.619153 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c9cffc3f-c886-4cd0-979f-46dba42275d9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:17.653704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-60893c0a-1fc7-4087-bbf1-75ed0355c53f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:17.655252 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c9cffc3f-c886-4cd0-979f-46dba42275d9 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/ips" status: 200 len: 146 microversion: 2.1 time: 0.062399 May 13 15:03:17.656834 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 437/841] 10.222.0.99 () {58 vars in 1247 bytes} [Fri May 13 15:03:17 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/ips => generated 146 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 15:03:17.662310 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-60893c0a-1fc7-4087-bbf1-75ed0355c53f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:17.664905 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-60893c0a-1fc7-4087-bbf1-75ed0355c53f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:17.665722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-60893c0a-1fc7-4087-bbf1-75ed0355c53f tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1740 microversion: 2.20 time: 0.225823 May 13 15:03:17.666359 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 405/842] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:17 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1740 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:18.690624 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-74f03576-6b72-4cc7-8929-caeccda12ae8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:18.691924 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-74f03576-6b72-4cc7-8929-caeccda12ae8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:18.699901 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-74f03576-6b72-4cc7-8929-caeccda12ae8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:18.700397 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-74f03576-6b72-4cc7-8929-caeccda12ae8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:18.701362 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-74f03576-6b72-4cc7-8929-caeccda12ae8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:18.702078 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-74f03576-6b72-4cc7-8929-caeccda12ae8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:18.878462 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-74f03576-6b72-4cc7-8929-caeccda12ae8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:18.888531 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-74f03576-6b72-4cc7-8929-caeccda12ae8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:18.890429 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-74f03576-6b72-4cc7-8929-caeccda12ae8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:18.892206 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-74f03576-6b72-4cc7-8929-caeccda12ae8 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1740 microversion: 2.20 time: 0.208791 May 13 15:03:18.893241 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 438/843] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:18 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:19.027709 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ba95d8a2-e0cb-433c-a357-b4706ea331ef tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc1e99c2-1bcd-4f71-9354-f4d2d4ee3db2"}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:03:19.031326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ba95d8a2-e0cb-433c-a357-b4706ea331ef tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:19.039170 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ba95d8a2-e0cb-433c-a357-b4706ea331ef tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:19.039619 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ba95d8a2-e0cb-433c-a357-b4706ea331ef tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:19.040431 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ba95d8a2-e0cb-433c-a357-b4706ea331ef tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:19.040943 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ba95d8a2-e0cb-433c-a357-b4706ea331ef tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:19.387412 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ba95d8a2-e0cb-433c-a357-b4706ea331ef tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "POST /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365062 May 13 15:03:19.388231 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 406/844] 10.222.0.99 () {60 vars in 1322 bytes} [Fri May 13 15:03:19 2022] POST /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:03:19.911473 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-cb034d9f-8e5d-43e8-a67b-fb0fd9653bd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:19.912054 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-cb034d9f-8e5d-43e8-a67b-fb0fd9653bd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:19.918721 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cb034d9f-8e5d-43e8-a67b-fb0fd9653bd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:19.919171 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cb034d9f-8e5d-43e8-a67b-fb0fd9653bd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:19.919997 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cb034d9f-8e5d-43e8-a67b-fb0fd9653bd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:19.920432 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cb034d9f-8e5d-43e8-a67b-fb0fd9653bd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:20.063447 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-cb034d9f-8e5d-43e8-a67b-fb0fd9653bd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:20.089967 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-cb034d9f-8e5d-43e8-a67b-fb0fd9653bd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:20.091668 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-cb034d9f-8e5d-43e8-a67b-fb0fd9653bd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:20.093114 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-cb034d9f-8e5d-43e8-a67b-fb0fd9653bd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1740 microversion: 2.20 time: 0.186206 May 13 15:03:20.105082 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 439/845] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:19 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:21.115733 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-30af24b6-7525-45f9-87e4-1b115b8d966c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:21.116439 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-30af24b6-7525-45f9-87e4-1b115b8d966c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:21.123964 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-30af24b6-7525-45f9-87e4-1b115b8d966c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:21.124589 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-30af24b6-7525-45f9-87e4-1b115b8d966c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:21.125814 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-30af24b6-7525-45f9-87e4-1b115b8d966c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:21.126499 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-30af24b6-7525-45f9-87e4-1b115b8d966c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:21.265914 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-30af24b6-7525-45f9-87e4-1b115b8d966c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:21.274326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-30af24b6-7525-45f9-87e4-1b115b8d966c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:21.275861 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-30af24b6-7525-45f9-87e4-1b115b8d966c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:21.277167 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-30af24b6-7525-45f9-87e4-1b115b8d966c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1740 microversion: 2.20 time: 0.167955 May 13 15:03:21.283481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 407/846] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:21 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:22.295345 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-81710d18-c396-4211-9489-c433034080f4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:22.296026 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-81710d18-c396-4211-9489-c433034080f4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:22.303358 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-81710d18-c396-4211-9489-c433034080f4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:22.303807 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-81710d18-c396-4211-9489-c433034080f4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:22.304626 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-81710d18-c396-4211-9489-c433034080f4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:22.305067 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-81710d18-c396-4211-9489-c433034080f4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:22.444231 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-81710d18-c396-4211-9489-c433034080f4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:22.452386 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-81710d18-c396-4211-9489-c433034080f4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:22.453954 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-81710d18-c396-4211-9489-c433034080f4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:22.455122 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-81710d18-c396-4211-9489-c433034080f4 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1722 microversion: 2.20 time: 0.163831 May 13 15:03:22.455733 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 440/847] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:22 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:23.479067 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-bb699b30-6d9a-48c5-a56a-5598c33acedb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:23.480160 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-bb699b30-6d9a-48c5-a56a-5598c33acedb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:23.489530 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bb699b30-6d9a-48c5-a56a-5598c33acedb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:23.489981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bb699b30-6d9a-48c5-a56a-5598c33acedb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:23.490765 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bb699b30-6d9a-48c5-a56a-5598c33acedb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:23.491203 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bb699b30-6d9a-48c5-a56a-5598c33acedb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:23.636867 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-bb699b30-6d9a-48c5-a56a-5598c33acedb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:23.645897 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-bb699b30-6d9a-48c5-a56a-5598c33acedb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:23.647389 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-bb699b30-6d9a-48c5-a56a-5598c33acedb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:23.648586 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-bb699b30-6d9a-48c5-a56a-5598c33acedb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1722 microversion: 2.20 time: 0.176898 May 13 15:03:23.649155 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 408/848] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:23 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:24.671799 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d625495e-3749-4bdb-a9ef-08ebe0f98f97 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:24.672666 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d625495e-3749-4bdb-a9ef-08ebe0f98f97 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:24.680277 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d625495e-3749-4bdb-a9ef-08ebe0f98f97 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:24.680726 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d625495e-3749-4bdb-a9ef-08ebe0f98f97 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:24.681520 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d625495e-3749-4bdb-a9ef-08ebe0f98f97 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:24.681976 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d625495e-3749-4bdb-a9ef-08ebe0f98f97 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:24.811806 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d625495e-3749-4bdb-a9ef-08ebe0f98f97 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:24.823737 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d625495e-3749-4bdb-a9ef-08ebe0f98f97 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:24.826150 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d625495e-3749-4bdb-a9ef-08ebe0f98f97 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:24.828000 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d625495e-3749-4bdb-a9ef-08ebe0f98f97 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1725 microversion: 2.20 time: 0.163273 May 13 15:03:24.828840 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 441/849] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:24 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:24.847828 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5a460e8e-5f10-41f6-baa6-b8ee9d434bf9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7d16eee-bbda-4ab7-889a-8ef7a4228df6"}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:03:24.848928 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5a460e8e-5f10-41f6-baa6-b8ee9d434bf9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:24.856371 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5a460e8e-5f10-41f6-baa6-b8ee9d434bf9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:24.856808 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5a460e8e-5f10-41f6-baa6-b8ee9d434bf9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:24.857573 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5a460e8e-5f10-41f6-baa6-b8ee9d434bf9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:24.857998 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5a460e8e-5f10-41f6-baa6-b8ee9d434bf9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:25.159060 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5a460e8e-5f10-41f6-baa6-b8ee9d434bf9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "POST /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.315421 May 13 15:03:25.159708 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 409/850] 10.222.0.99 () {62 vars in 1363 bytes} [Fri May 13 15:03:24 2022] POST /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894/os-volume_attachments => generated 188 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 15:03:25.287340 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-bf48c35a-e8a5-45dc-b52e-40682b2df7ea tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:25.287836 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-bf48c35a-e8a5-45dc-b52e-40682b2df7ea tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:25.293880 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf48c35a-e8a5-45dc-b52e-40682b2df7ea tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:25.294328 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf48c35a-e8a5-45dc-b52e-40682b2df7ea tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:25.295095 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf48c35a-e8a5-45dc-b52e-40682b2df7ea tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:25.295503 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bf48c35a-e8a5-45dc-b52e-40682b2df7ea tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:25.556337 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-bf48c35a-e8a5-45dc-b52e-40682b2df7ea tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "DELETE /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894/os-volume_attachments/c7d16eee-bbda-4ab7-889a-8ef7a4228df6" status: 202 len: 0 microversion: 2.20 time: 0.274581 May 13 15:03:25.556943 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 442/851] 10.222.0.99 () {60 vars in 1456 bytes} [Fri May 13 15:03:25 2022] DELETE /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894/os-volume_attachments/c7d16eee-bbda-4ab7-889a-8ef7a4228df6 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 15:03:25.614431 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-fec97665-b006-4a25-bc2d-0590f9153f87 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:03:25.614997 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-fec97665-b006-4a25-bc2d-0590f9153f87 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:25.622215 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-fec97665-b006-4a25-bc2d-0590f9153f87 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:25.622684 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-fec97665-b006-4a25-bc2d-0590f9153f87 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:25.623461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-fec97665-b006-4a25-bc2d-0590f9153f87 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:25.623902 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-fec97665-b006-4a25-bc2d-0590f9153f87 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:25.708227 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-fec97665-b006-4a25-bc2d-0590f9153f87 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "POST /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894/action" status: 202 len: 0 microversion: 2.20 time: 0.097683 May 13 15:03:25.709450 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 410/852] 10.222.0.99 () {62 vars in 1318 bytes} [Fri May 13 15:03:25 2022] POST /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 15:03:25.717459 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ac0a96ab-94e0-431c-94ca-0d2e027d1f80 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:25.718097 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ac0a96ab-94e0-431c-94ca-0d2e027d1f80 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:25.725217 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ac0a96ab-94e0-431c-94ca-0d2e027d1f80 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:25.725665 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ac0a96ab-94e0-431c-94ca-0d2e027d1f80 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:25.726452 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ac0a96ab-94e0-431c-94ca-0d2e027d1f80 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:25.727214 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ac0a96ab-94e0-431c-94ca-0d2e027d1f80 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:25.882637 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ac0a96ab-94e0-431c-94ca-0d2e027d1f80 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:25.890796 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ac0a96ab-94e0-431c-94ca-0d2e027d1f80 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:25.892297 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ac0a96ab-94e0-431c-94ca-0d2e027d1f80 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:25.893452 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ac0a96ab-94e0-431c-94ca-0d2e027d1f80 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1673 microversion: 2.20 time: 0.180087 May 13 15:03:25.894010 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 443/853] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:25 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1673 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:26.329570 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-b2a15e8a-f537-4def-a6d4-75189a942c6e req-f7f6706b-3d1f-4e40-a3e9-039e0615df8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d326e41-aedb-47b1-bf2f-e7784d3d4894", "name": "network-vif-unplugged", "status": "completed", "tag": "31bf981e-aa80-4a0b-a642-84d2bded56aa"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:03:26.339242 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-b2a15e8a-f537-4def-a6d4-75189a942c6e req-f7f6706b-3d1f-4e40-a3e9-039e0615df8e service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:26.339983 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-b2a15e8a-f537-4def-a6d4-75189a942c6e req-f7f6706b-3d1f-4e40-a3e9-039e0615df8e service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:26.353309 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.compute.server_external_events [req-b2a15e8a-f537-4def-a6d4-75189a942c6e req-f7f6706b-3d1f-4e40-a3e9-039e0615df8e service nova] Unable to find a host for instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894. Dropping event network-vif-unplugged {{(pid=117296) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 13 15:03:26.354219 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-b2a15e8a-f537-4def-a6d4-75189a942c6e req-f7f6706b-3d1f-4e40-a3e9-039e0615df8e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028549 May 13 15:03:26.355120 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 411/854] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 13 15:03:26.912469 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-7f8590b9-00fe-4f81-be10-8d4739b9afce tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:26.913166 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-7f8590b9-00fe-4f81-be10-8d4739b9afce tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:26.919155 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9a7a137d-3479-4a13-9095-d1c34a9427f0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:26.919989 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7f8590b9-00fe-4f81-be10-8d4739b9afce tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:26.920186 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-9a7a137d-3479-4a13-9095-d1c34a9427f0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:26.920579 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7f8590b9-00fe-4f81-be10-8d4739b9afce tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:26.921424 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7f8590b9-00fe-4f81-be10-8d4739b9afce tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:26.921927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-7f8590b9-00fe-4f81-be10-8d4739b9afce tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:26.926186 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9a7a137d-3479-4a13-9095-d1c34a9427f0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:26.926878 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9a7a137d-3479-4a13-9095-d1c34a9427f0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:26.927795 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9a7a137d-3479-4a13-9095-d1c34a9427f0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:26.928263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9a7a137d-3479-4a13-9095-d1c34a9427f0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:26.957145 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9a7a137d-3479-4a13-9095-d1c34a9427f0 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041866 May 13 15:03:26.958429 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 412/855] 10.222.0.99 () {58 vars in 1301 bytes} [Fri May 13 15:03:26 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:03:26.968659 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7a360c5b-28be-4cde-ac17-d8c23f147377 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:26.969193 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7a360c5b-28be-4cde-ac17-d8c23f147377 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:26.975967 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7a360c5b-28be-4cde-ac17-d8c23f147377 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:26.976415 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7a360c5b-28be-4cde-ac17-d8c23f147377 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:26.977533 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7a360c5b-28be-4cde-ac17-d8c23f147377 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:26.977971 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7a360c5b-28be-4cde-ac17-d8c23f147377 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:27.008056 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7a360c5b-28be-4cde-ac17-d8c23f147377 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments/bc1e99c2-1bcd-4f71-9354-f4d2d4ee3db2" status: 200 len: 194 microversion: 2.1 time: 0.043991 May 13 15:03:27.008649 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 413/856] 10.222.0.99 () {58 vars in 1412 bytes} [Fri May 13 15:03:26 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments/bc1e99c2-1bcd-4f71-9354-f4d2d4ee3db2 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 15:03:27.055228 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-7f8590b9-00fe-4f81-be10-8d4739b9afce tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:27.063184 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-7f8590b9-00fe-4f81-be10-8d4739b9afce tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:27.065710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-7f8590b9-00fe-4f81-be10-8d4739b9afce tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:27.066911 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-7f8590b9-00fe-4f81-be10-8d4739b9afce tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.158411 May 13 15:03:27.068007 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 444/857] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:26 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:28.086230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-acad4680-66c8-45be-b7fa-0fb3af705287 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:28.086926 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-acad4680-66c8-45be-b7fa-0fb3af705287 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:28.093456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-acad4680-66c8-45be-b7fa-0fb3af705287 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:28.093968 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-acad4680-66c8-45be-b7fa-0fb3af705287 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:28.094820 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-acad4680-66c8-45be-b7fa-0fb3af705287 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:28.095334 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-acad4680-66c8-45be-b7fa-0fb3af705287 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:28.232128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-acad4680-66c8-45be-b7fa-0fb3af705287 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:28.240127 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-acad4680-66c8-45be-b7fa-0fb3af705287 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:28.241615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-acad4680-66c8-45be-b7fa-0fb3af705287 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:28.242845 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-acad4680-66c8-45be-b7fa-0fb3af705287 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.160673 May 13 15:03:28.243410 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 414/858] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:28 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:28.346571 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-5e76a6fb-c175-4f22-ad2e-e77b0b865d2f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e34dba3-1c24-43a3-9570-c0411028a773"}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:03:28.348671 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-5e76a6fb-c175-4f22-ad2e-e77b0b865d2f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:28.356445 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5e76a6fb-c175-4f22-ad2e-e77b0b865d2f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:28.357158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5e76a6fb-c175-4f22-ad2e-e77b0b865d2f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:28.358163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5e76a6fb-c175-4f22-ad2e-e77b0b865d2f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:28.358868 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5e76a6fb-c175-4f22-ad2e-e77b0b865d2f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:29.261318 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-52ae560b-7403-4aec-a6d1-61676d147aaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:29.262108 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-52ae560b-7403-4aec-a6d1-61676d147aaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:29.269397 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-52ae560b-7403-4aec-a6d1-61676d147aaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:29.270147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-52ae560b-7403-4aec-a6d1-61676d147aaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:29.271053 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-52ae560b-7403-4aec-a6d1-61676d147aaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:29.271692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-52ae560b-7403-4aec-a6d1-61676d147aaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:29.408598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-52ae560b-7403-4aec-a6d1-61676d147aaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:29.417423 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-52ae560b-7403-4aec-a6d1-61676d147aaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:29.419034 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-52ae560b-7403-4aec-a6d1-61676d147aaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:29.420246 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-52ae560b-7403-4aec-a6d1-61676d147aaf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.162938 May 13 15:03:29.420815 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 415/859] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:29 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:30.439761 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e1f2c2c9-5c46-465b-800a-72587d9d72fb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:30.440502 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-e1f2c2c9-5c46-465b-800a-72587d9d72fb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:30.447307 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e1f2c2c9-5c46-465b-800a-72587d9d72fb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:30.447682 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e1f2c2c9-5c46-465b-800a-72587d9d72fb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:30.448500 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e1f2c2c9-5c46-465b-800a-72587d9d72fb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:30.448933 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e1f2c2c9-5c46-465b-800a-72587d9d72fb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:30.590222 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e1f2c2c9-5c46-465b-800a-72587d9d72fb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:30.598601 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e1f2c2c9-5c46-465b-800a-72587d9d72fb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:30.600146 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e1f2c2c9-5c46-465b-800a-72587d9d72fb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:30.601374 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e1f2c2c9-5c46-465b-800a-72587d9d72fb tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.166201 May 13 15:03:30.602258 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 416/860] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:30 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:31.620941 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-dae6abf7-c967-40f4-b5c5-2750a00fb612 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:31.621779 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-dae6abf7-c967-40f4-b5c5-2750a00fb612 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:31.628172 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dae6abf7-c967-40f4-b5c5-2750a00fb612 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:31.628592 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dae6abf7-c967-40f4-b5c5-2750a00fb612 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:31.629378 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dae6abf7-c967-40f4-b5c5-2750a00fb612 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:31.629815 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dae6abf7-c967-40f4-b5c5-2750a00fb612 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:31.773419 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-dae6abf7-c967-40f4-b5c5-2750a00fb612 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:31.781783 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-dae6abf7-c967-40f4-b5c5-2750a00fb612 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:31.783333 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-dae6abf7-c967-40f4-b5c5-2750a00fb612 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:31.784522 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-dae6abf7-c967-40f4-b5c5-2750a00fb612 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.167559 May 13 15:03:31.785092 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 417/861] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:31 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:32.803139 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5e5f4dbe-eeb0-4435-abfe-ab5cb581de3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:32.803834 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5e5f4dbe-eeb0-4435-abfe-ab5cb581de3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:32.810769 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5e5f4dbe-eeb0-4435-abfe-ab5cb581de3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:32.811224 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5e5f4dbe-eeb0-4435-abfe-ab5cb581de3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:32.812053 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5e5f4dbe-eeb0-4435-abfe-ab5cb581de3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:32.812501 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5e5f4dbe-eeb0-4435-abfe-ab5cb581de3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:32.950869 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5e5f4dbe-eeb0-4435-abfe-ab5cb581de3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:32.960867 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5e5f4dbe-eeb0-4435-abfe-ab5cb581de3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:32.962672 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5e5f4dbe-eeb0-4435-abfe-ab5cb581de3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:32.963919 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5e5f4dbe-eeb0-4435-abfe-ab5cb581de3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.164820 May 13 15:03:32.964517 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 418/862] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:32 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:33.983825 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8f11e429-83a5-43c8-a2f6-59e7cfdbaf14 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:33.984570 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8f11e429-83a5-43c8-a2f6-59e7cfdbaf14 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:33.990953 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f11e429-83a5-43c8-a2f6-59e7cfdbaf14 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:33.991394 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f11e429-83a5-43c8-a2f6-59e7cfdbaf14 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:33.992179 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f11e429-83a5-43c8-a2f6-59e7cfdbaf14 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:33.992609 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8f11e429-83a5-43c8-a2f6-59e7cfdbaf14 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:34.135607 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8f11e429-83a5-43c8-a2f6-59e7cfdbaf14 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:34.144297 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8f11e429-83a5-43c8-a2f6-59e7cfdbaf14 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:34.145959 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8f11e429-83a5-43c8-a2f6-59e7cfdbaf14 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:34.147299 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8f11e429-83a5-43c8-a2f6-59e7cfdbaf14 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.167414 May 13 15:03:34.147954 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 419/863] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:33 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:35.166010 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-07db77ad-17ca-4aa5-a2c9-9c545fa53b5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:35.166675 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-07db77ad-17ca-4aa5-a2c9-9c545fa53b5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:35.173698 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-07db77ad-17ca-4aa5-a2c9-9c545fa53b5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:35.174147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-07db77ad-17ca-4aa5-a2c9-9c545fa53b5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:35.174933 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-07db77ad-17ca-4aa5-a2c9-9c545fa53b5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:35.175365 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-07db77ad-17ca-4aa5-a2c9-9c545fa53b5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:35.313847 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-07db77ad-17ca-4aa5-a2c9-9c545fa53b5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:35.322300 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-07db77ad-17ca-4aa5-a2c9-9c545fa53b5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:35.324097 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-07db77ad-17ca-4aa5-a2c9-9c545fa53b5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:35.325321 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-07db77ad-17ca-4aa5-a2c9-9c545fa53b5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.163643 May 13 15:03:35.325883 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 420/864] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:35 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:36.343392 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-dd0a339b-2649-4347-96b5-52f2cd909739 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:36.344788 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-dd0a339b-2649-4347-96b5-52f2cd909739 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:36.350802 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dd0a339b-2649-4347-96b5-52f2cd909739 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:36.351569 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dd0a339b-2649-4347-96b5-52f2cd909739 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:36.352389 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dd0a339b-2649-4347-96b5-52f2cd909739 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:36.352851 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dd0a339b-2649-4347-96b5-52f2cd909739 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:36.490553 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-dd0a339b-2649-4347-96b5-52f2cd909739 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:36.499562 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-dd0a339b-2649-4347-96b5-52f2cd909739 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:36.501208 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-dd0a339b-2649-4347-96b5-52f2cd909739 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:36.502411 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-dd0a339b-2649-4347-96b5-52f2cd909739 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.163223 May 13 15:03:36.502984 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 421/865] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:36 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 15:03:37.521091 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-98d57a6b-c814-453d-b094-4f5932b33f3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:37.521899 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-98d57a6b-c814-453d-b094-4f5932b33f3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:37.528551 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-98d57a6b-c814-453d-b094-4f5932b33f3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:37.528998 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-98d57a6b-c814-453d-b094-4f5932b33f3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:37.529812 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-98d57a6b-c814-453d-b094-4f5932b33f3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:37.530251 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-98d57a6b-c814-453d-b094-4f5932b33f3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:37.674130 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-98d57a6b-c814-453d-b094-4f5932b33f3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:37.682298 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-98d57a6b-c814-453d-b094-4f5932b33f3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:37.683902 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-98d57a6b-c814-453d-b094-4f5932b33f3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:37.685087 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-98d57a6b-c814-453d-b094-4f5932b33f3b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.167942 May 13 15:03:37.685863 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 422/866] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:37 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 15:03:38.706927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e27b2d7d-767f-44a6-87da-ef29a39cddbf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:38.708008 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-e27b2d7d-767f-44a6-87da-ef29a39cddbf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:38.717326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e27b2d7d-767f-44a6-87da-ef29a39cddbf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:38.717784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e27b2d7d-767f-44a6-87da-ef29a39cddbf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:38.718566 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e27b2d7d-767f-44a6-87da-ef29a39cddbf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:38.718999 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e27b2d7d-767f-44a6-87da-ef29a39cddbf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:38.855476 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e27b2d7d-767f-44a6-87da-ef29a39cddbf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:38.867855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e27b2d7d-767f-44a6-87da-ef29a39cddbf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:38.870327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e27b2d7d-767f-44a6-87da-ef29a39cddbf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:38.871478 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e27b2d7d-767f-44a6-87da-ef29a39cddbf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.171246 May 13 15:03:38.872067 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 423/867] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:38 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:39.898483 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5541547b-38e6-474f-9da4-99ab3d2f3292 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:39.899500 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5541547b-38e6-474f-9da4-99ab3d2f3292 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:39.907192 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5541547b-38e6-474f-9da4-99ab3d2f3292 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:39.907637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5541547b-38e6-474f-9da4-99ab3d2f3292 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:39.908436 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5541547b-38e6-474f-9da4-99ab3d2f3292 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:39.908862 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5541547b-38e6-474f-9da4-99ab3d2f3292 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:40.039450 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5541547b-38e6-474f-9da4-99ab3d2f3292 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:40.047448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5541547b-38e6-474f-9da4-99ab3d2f3292 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:40.048950 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5541547b-38e6-474f-9da4-99ab3d2f3292 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:40.050133 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5541547b-38e6-474f-9da4-99ab3d2f3292 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.158415 May 13 15:03:40.050736 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 424/868] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:39 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:41.076485 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-57610f0b-fde4-4c28-b967-f1b57515d220 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:41.077241 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-57610f0b-fde4-4c28-b967-f1b57515d220 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:41.083718 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-57610f0b-fde4-4c28-b967-f1b57515d220 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:41.084255 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-57610f0b-fde4-4c28-b967-f1b57515d220 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:41.085064 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-57610f0b-fde4-4c28-b967-f1b57515d220 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:41.085499 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-57610f0b-fde4-4c28-b967-f1b57515d220 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:41.224293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-57610f0b-fde4-4c28-b967-f1b57515d220 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:41.233082 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-57610f0b-fde4-4c28-b967-f1b57515d220 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:41.234638 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-57610f0b-fde4-4c28-b967-f1b57515d220 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:41.235805 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-57610f0b-fde4-4c28-b967-f1b57515d220 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.167756 May 13 15:03:41.236417 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 425/869] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:41 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:42.258728 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-0ee520e5-a014-4f90-9026-6e73325ba33a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:42.259959 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-0ee520e5-a014-4f90-9026-6e73325ba33a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:42.270422 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0ee520e5-a014-4f90-9026-6e73325ba33a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:42.271163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0ee520e5-a014-4f90-9026-6e73325ba33a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:42.272498 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0ee520e5-a014-4f90-9026-6e73325ba33a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:42.273279 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0ee520e5-a014-4f90-9026-6e73325ba33a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:42.410203 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-0ee520e5-a014-4f90-9026-6e73325ba33a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:42.418978 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-0ee520e5-a014-4f90-9026-6e73325ba33a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:42.420503 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-0ee520e5-a014-4f90-9026-6e73325ba33a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:42.421672 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-0ee520e5-a014-4f90-9026-6e73325ba33a tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.169012 May 13 15:03:42.422254 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 426/870] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:42 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:42.942336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-5e76a6fb-c175-4f22-ad2e-e77b0b865d2f tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "POST /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.599613 May 13 15:03:42.943025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 445/871] 10.222.0.99 () {60 vars in 1322 bytes} [Fri May 13 15:03:28 2022] POST /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments => generated 194 bytes in 14602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:03:43.449244 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b87be3af-70b3-43cc-a1d7-e5bfee942c98 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:43.450159 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b87be3af-70b3-43cc-a1d7-e5bfee942c98 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:43.457406 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b87be3af-70b3-43cc-a1d7-e5bfee942c98 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:43.457852 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b87be3af-70b3-43cc-a1d7-e5bfee942c98 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:43.458600 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b87be3af-70b3-43cc-a1d7-e5bfee942c98 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:43.459030 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b87be3af-70b3-43cc-a1d7-e5bfee942c98 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:43.593130 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b87be3af-70b3-43cc-a1d7-e5bfee942c98 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:43.601669 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b87be3af-70b3-43cc-a1d7-e5bfee942c98 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:43.603178 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b87be3af-70b3-43cc-a1d7-e5bfee942c98 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:43.604489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b87be3af-70b3-43cc-a1d7-e5bfee942c98 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.161874 May 13 15:03:43.605104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 427/872] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:43 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:44.624514 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-68aadd32-6d4c-4a70-abf4-86a391fc6129 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:44.625151 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-68aadd32-6d4c-4a70-abf4-86a391fc6129 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:44.632023 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68aadd32-6d4c-4a70-abf4-86a391fc6129 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:44.632468 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68aadd32-6d4c-4a70-abf4-86a391fc6129 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:44.633242 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68aadd32-6d4c-4a70-abf4-86a391fc6129 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:44.633702 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-68aadd32-6d4c-4a70-abf4-86a391fc6129 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:44.776925 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-68aadd32-6d4c-4a70-abf4-86a391fc6129 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:44.785304 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-68aadd32-6d4c-4a70-abf4-86a391fc6129 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:44.786775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-68aadd32-6d4c-4a70-abf4-86a391fc6129 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:44.787928 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-68aadd32-6d4c-4a70-abf4-86a391fc6129 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.168605 May 13 15:03:44.788486 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 446/873] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:44 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:45.807975 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c8daa8e1-6219-42f4-a0bc-eaadfbde2996 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:45.808722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c8daa8e1-6219-42f4-a0bc-eaadfbde2996 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:45.816571 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c8daa8e1-6219-42f4-a0bc-eaadfbde2996 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:45.817046 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c8daa8e1-6219-42f4-a0bc-eaadfbde2996 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:45.817801 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c8daa8e1-6219-42f4-a0bc-eaadfbde2996 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:45.818238 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c8daa8e1-6219-42f4-a0bc-eaadfbde2996 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:45.958346 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c8daa8e1-6219-42f4-a0bc-eaadfbde2996 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:45.968043 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c8daa8e1-6219-42f4-a0bc-eaadfbde2996 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:45.969533 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c8daa8e1-6219-42f4-a0bc-eaadfbde2996 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:45.970682 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c8daa8e1-6219-42f4-a0bc-eaadfbde2996 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.168263 May 13 15:03:45.971265 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 428/874] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:45 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:46.543171 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-40ad98bd-e076-49d5-81eb-2eec4ae5b272 req-c719024a-48d9-4e2b-a9e0-cad4294070cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d326e41-aedb-47b1-bf2f-e7784d3d4894", "name": "network-vif-plugged", "status": "completed", "tag": "31bf981e-aa80-4a0b-a642-84d2bded56aa"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:03:46.553017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-40ad98bd-e076-49d5-81eb-2eec4ae5b272 req-c719024a-48d9-4e2b-a9e0-cad4294070cd service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:46.553452 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-40ad98bd-e076-49d5-81eb-2eec4ae5b272 req-c719024a-48d9-4e2b-a9e0-cad4294070cd service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:46.565375 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-40ad98bd-e076-49d5-81eb-2eec4ae5b272 req-c719024a-48d9-4e2b-a9e0-cad4294070cd service nova] Creating event network-vif-plugged:31bf981e-aa80-4a0b-a642-84d2bded56aa for instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 on hv-cinder-83090 May 13 15:03:46.570383 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-40ad98bd-e076-49d5-81eb-2eec4ae5b272 req-c719024a-48d9-4e2b-a9e0-cad4294070cd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030953 May 13 15:03:46.570978 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 447/875] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:03:46.993806 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cd10ac80-b2b1-4b4b-9726-472612b38acf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:46.994537 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-cd10ac80-b2b1-4b4b-9726-472612b38acf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:47.001435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cd10ac80-b2b1-4b4b-9726-472612b38acf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:47.001881 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cd10ac80-b2b1-4b4b-9726-472612b38acf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:47.002670 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cd10ac80-b2b1-4b4b-9726-472612b38acf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:47.003080 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cd10ac80-b2b1-4b4b-9726-472612b38acf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:47.142490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-cd10ac80-b2b1-4b4b-9726-472612b38acf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:47.151229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-cd10ac80-b2b1-4b4b-9726-472612b38acf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:47.152757 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-cd10ac80-b2b1-4b4b-9726-472612b38acf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:47.153921 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-cd10ac80-b2b1-4b4b-9726-472612b38acf tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.164196 May 13 15:03:47.154498 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 429/876] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:46 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:48.178921 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ddbcff8b-24c3-44ce-86f7-3113b40161d6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:48.180143 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ddbcff8b-24c3-44ce-86f7-3113b40161d6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:48.191449 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ddbcff8b-24c3-44ce-86f7-3113b40161d6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:48.192295 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ddbcff8b-24c3-44ce-86f7-3113b40161d6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:48.193604 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ddbcff8b-24c3-44ce-86f7-3113b40161d6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:48.194316 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ddbcff8b-24c3-44ce-86f7-3113b40161d6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:48.344647 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ddbcff8b-24c3-44ce-86f7-3113b40161d6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:48.357109 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ddbcff8b-24c3-44ce-86f7-3113b40161d6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:48.358770 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ddbcff8b-24c3-44ce-86f7-3113b40161d6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:48.360012 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ddbcff8b-24c3-44ce-86f7-3113b40161d6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.189682 May 13 15:03:48.360588 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 448/877] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:48 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:03:49.379328 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8d6e14a2-2e1b-4c31-b51f-57fca8f865c6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:49.379975 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8d6e14a2-2e1b-4c31-b51f-57fca8f865c6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:49.386671 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8d6e14a2-2e1b-4c31-b51f-57fca8f865c6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:49.387218 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8d6e14a2-2e1b-4c31-b51f-57fca8f865c6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:49.388147 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8d6e14a2-2e1b-4c31-b51f-57fca8f865c6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:49.388652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8d6e14a2-2e1b-4c31-b51f-57fca8f865c6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:49.699911 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8d6e14a2-2e1b-4c31-b51f-57fca8f865c6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:49.708561 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8d6e14a2-2e1b-4c31-b51f-57fca8f865c6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:49.710023 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8d6e14a2-2e1b-4c31-b51f-57fca8f865c6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:49.711167 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8d6e14a2-2e1b-4c31-b51f-57fca8f865c6 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1731 microversion: 2.20 time: 0.336620 May 13 15:03:49.711725 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 430/878] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:49 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1731 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 15:03:50.472131 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-153a6389-afaa-4992-90b3-a06acf239ace tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:50.473125 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-153a6389-afaa-4992-90b3-a06acf239ace tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:50.481783 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-153a6389-afaa-4992-90b3-a06acf239ace tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:50.482239 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-153a6389-afaa-4992-90b3-a06acf239ace tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:50.483068 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-153a6389-afaa-4992-90b3-a06acf239ace tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:50.483516 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-153a6389-afaa-4992-90b3-a06acf239ace tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:50.516932 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-153a6389-afaa-4992-90b3-a06acf239ace tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048778 May 13 15:03:50.517527 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 449/879] 10.222.0.99 () {58 vars in 1301 bytes} [Fri May 13 15:03:50 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:03:50.658154 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6732ac47-e85a-4b05-b64b-4e20e85cd332 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:50.658865 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6732ac47-e85a-4b05-b64b-4e20e85cd332 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:50.666943 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6732ac47-e85a-4b05-b64b-4e20e85cd332 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:50.667507 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6732ac47-e85a-4b05-b64b-4e20e85cd332 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:50.668698 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6732ac47-e85a-4b05-b64b-4e20e85cd332 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:50.669321 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6732ac47-e85a-4b05-b64b-4e20e85cd332 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:50.699847 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6732ac47-e85a-4b05-b64b-4e20e85cd332 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments/bc1e99c2-1bcd-4f71-9354-f4d2d4ee3db2" status: 200 len: 194 microversion: 2.1 time: 0.047641 May 13 15:03:50.700444 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 431/880] 10.222.0.99 () {58 vars in 1412 bytes} [Fri May 13 15:03:50 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments/bc1e99c2-1bcd-4f71-9354-f4d2d4ee3db2 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:03:50.710402 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-aaffacb4-41c6-4d53-abb4-8950ba3fb299 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:50.710882 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-aaffacb4-41c6-4d53-abb4-8950ba3fb299 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:50.717562 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-aaffacb4-41c6-4d53-abb4-8950ba3fb299 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:50.718075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-aaffacb4-41c6-4d53-abb4-8950ba3fb299 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:50.718859 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-aaffacb4-41c6-4d53-abb4-8950ba3fb299 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:50.719294 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-aaffacb4-41c6-4d53-abb4-8950ba3fb299 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:50.729530 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8e7849ee-6cc1-4c44-876a-2a1026d6297b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:50.730157 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8e7849ee-6cc1-4c44-876a-2a1026d6297b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:50.735977 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8e7849ee-6cc1-4c44-876a-2a1026d6297b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:50.736395 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8e7849ee-6cc1-4c44-876a-2a1026d6297b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:50.737169 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8e7849ee-6cc1-4c44-876a-2a1026d6297b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:50.737600 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8e7849ee-6cc1-4c44-876a-2a1026d6297b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:50.808762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-aaffacb4-41c6-4d53-abb4-8950ba3fb299 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lazy-loading 'services' on Instance uuid 6d93a166-e753-4779-bd52-67f67445c3c9 {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:03:50.866877 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8e7849ee-6cc1-4c44-876a-2a1026d6297b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:50.875206 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8e7849ee-6cc1-4c44-876a-2a1026d6297b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:50.876692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8e7849ee-6cc1-4c44-876a-2a1026d6297b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:50.877847 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8e7849ee-6cc1-4c44-876a-2a1026d6297b tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1718 microversion: 2.20 time: 0.152635 May 13 15:03:50.878403 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 432/881] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:03:50 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1718 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 15:03:50.880464 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-aaffacb4-41c6-4d53-abb4-8950ba3fb299 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "DELETE /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments/bc1e99c2-1bcd-4f71-9354-f4d2d4ee3db2" status: 202 len: 0 microversion: 2.1 time: 0.173823 May 13 15:03:50.881319 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 450/882] 10.222.0.99 () {58 vars in 1415 bytes} [Fri May 13 15:03:50 2022] DELETE /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments/bc1e99c2-1bcd-4f71-9354-f4d2d4ee3db2 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:03:53.069636 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c74f60d9-394d-4998-880f-b881ac15705d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:53.070456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c74f60d9-394d-4998-880f-b881ac15705d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:53.078605 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c74f60d9-394d-4998-880f-b881ac15705d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:53.079062 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c74f60d9-394d-4998-880f-b881ac15705d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:53.079836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c74f60d9-394d-4998-880f-b881ac15705d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:53.080318 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c74f60d9-394d-4998-880f-b881ac15705d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:53.109057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c74f60d9-394d-4998-880f-b881ac15705d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments/2e34dba3-1c24-43a3-9570-c0411028a773" status: 200 len: 194 microversion: 2.1 time: 0.045805 May 13 15:03:53.109617 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 433/883] 10.222.0.99 () {58 vars in 1412 bytes} [Fri May 13 15:03:53 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments/2e34dba3-1c24-43a3-9570-c0411028a773 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:03:53.120304 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-775bf51f-1101-4090-83ce-43ffb1005944 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:53.120846 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-775bf51f-1101-4090-83ce-43ffb1005944 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:53.128825 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-775bf51f-1101-4090-83ce-43ffb1005944 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:53.129435 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-775bf51f-1101-4090-83ce-43ffb1005944 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:53.130576 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-775bf51f-1101-4090-83ce-43ffb1005944 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:53.131193 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-775bf51f-1101-4090-83ce-43ffb1005944 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:53.219428 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-775bf51f-1101-4090-83ce-43ffb1005944 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lazy-loading 'services' on Instance uuid 6d93a166-e753-4779-bd52-67f67445c3c9 {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:03:53.297484 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-775bf51f-1101-4090-83ce-43ffb1005944 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "DELETE /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments/2e34dba3-1c24-43a3-9570-c0411028a773" status: 202 len: 0 microversion: 2.1 time: 0.181383 May 13 15:03:53.298117 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 451/884] 10.222.0.99 () {58 vars in 1415 bytes} [Fri May 13 15:03:53 2022] DELETE /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments/2e34dba3-1c24-43a3-9570-c0411028a773 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:03:54.455560 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-19cd3e51-9390-4d43-bcf7-24faaf12aa17 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:54.456593 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-19cd3e51-9390-4d43-bcf7-24faaf12aa17 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:54.463305 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-19cd3e51-9390-4d43-bcf7-24faaf12aa17 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:54.463758 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-19cd3e51-9390-4d43-bcf7-24faaf12aa17 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:54.464581 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-19cd3e51-9390-4d43-bcf7-24faaf12aa17 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:54.465024 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-19cd3e51-9390-4d43-bcf7-24faaf12aa17 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:54.494770 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-19cd3e51-9390-4d43-bcf7-24faaf12aa17 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043309 May 13 15:03:54.495322 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 434/885] 10.222.0.99 () {58 vars in 1301 bytes} [Fri May 13 15:03:54 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 15:03:54.609021 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-13158d25-08b2-48f8-8ffa-bcddddad710b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:54.610038 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-13158d25-08b2-48f8-8ffa-bcddddad710b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:54.617050 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-13158d25-08b2-48f8-8ffa-bcddddad710b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:54.617499 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-13158d25-08b2-48f8-8ffa-bcddddad710b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:54.618279 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-13158d25-08b2-48f8-8ffa-bcddddad710b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:54.618715 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-13158d25-08b2-48f8-8ffa-bcddddad710b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:54.648955 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-13158d25-08b2-48f8-8ffa-bcddddad710b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044806 May 13 15:03:54.649667 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 452/886] 10.222.0.99 () {58 vars in 1301 bytes} [Fri May 13 15:03:54 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 15:03:54.710528 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-131f53cc-677b-4211-8337-f9c9f959220d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:54.711036 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-131f53cc-677b-4211-8337-f9c9f959220d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:54.717853 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-131f53cc-677b-4211-8337-f9c9f959220d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:54.718299 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-131f53cc-677b-4211-8337-f9c9f959220d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:54.719071 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-131f53cc-677b-4211-8337-f9c9f959220d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:54.719507 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-131f53cc-677b-4211-8337-f9c9f959220d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:54.745780 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-131f53cc-677b-4211-8337-f9c9f959220d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Going to try to terminate instance {{(pid=117296) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 15:03:54.830213 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-131f53cc-677b-4211-8337-f9c9f959220d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "DELETE /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 204 len: 0 microversion: 2.1 time: 0.123332 May 13 15:03:54.831243 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 435/887] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:03:54 2022] DELETE /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 15:03:54.844838 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-caead02e-1092-47c8-9e95-ff41a06e9780 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:54.845750 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-caead02e-1092-47c8-9e95-ff41a06e9780 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:54.854957 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-caead02e-1092-47c8-9e95-ff41a06e9780 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:54.855676 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-caead02e-1092-47c8-9e95-ff41a06e9780 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:54.856918 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-caead02e-1092-47c8-9e95-ff41a06e9780 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:54.857527 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-caead02e-1092-47c8-9e95-ff41a06e9780 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:55.010124 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-caead02e-1092-47c8-9e95-ff41a06e9780 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:55.017964 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-caead02e-1092-47c8-9e95-ff41a06e9780 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1672 microversion: 2.1 time: 0.180199 May 13 15:03:55.018555 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 453/888] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:03:54 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1672 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:03:56.037564 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-86e272c6-0700-4d0a-b3e1-4f35caf4799e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:56.038240 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-86e272c6-0700-4d0a-b3e1-4f35caf4799e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:56.044876 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-86e272c6-0700-4d0a-b3e1-4f35caf4799e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:56.045338 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-86e272c6-0700-4d0a-b3e1-4f35caf4799e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:56.046291 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-86e272c6-0700-4d0a-b3e1-4f35caf4799e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:56.046717 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-86e272c6-0700-4d0a-b3e1-4f35caf4799e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:56.186291 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-86e272c6-0700-4d0a-b3e1-4f35caf4799e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:56.194193 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-86e272c6-0700-4d0a-b3e1-4f35caf4799e tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1672 microversion: 2.1 time: 0.161012 May 13 15:03:56.194770 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 436/889] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:03:56 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:03:57.211660 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-22c2ee41-8e08-47c4-86e1-f1e9f204f17c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:57.212321 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-22c2ee41-8e08-47c4-86e1-f1e9f204f17c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:57.219093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-22c2ee41-8e08-47c4-86e1-f1e9f204f17c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:57.219535 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-22c2ee41-8e08-47c4-86e1-f1e9f204f17c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:57.220336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-22c2ee41-8e08-47c4-86e1-f1e9f204f17c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:57.220761 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-22c2ee41-8e08-47c4-86e1-f1e9f204f17c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:57.353968 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-22c2ee41-8e08-47c4-86e1-f1e9f204f17c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:57.361500 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-22c2ee41-8e08-47c4-86e1-f1e9f204f17c tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1672 microversion: 2.1 time: 0.153735 May 13 15:03:57.362107 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 454/890] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:03:57 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:03:57.872060 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-59472212-91e7-4cee-9344-23f1d413b421 req-8f87b124-90a8-41b0-a0c6-9d1a1d2b8940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d93a166-e753-4779-bd52-67f67445c3c9", "name": "network-vif-deleted", "tag": "b93715cd-b844-448b-8661-4c58ce13542c"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:03:57.883550 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-59472212-91e7-4cee-9344-23f1d413b421 req-8f87b124-90a8-41b0-a0c6-9d1a1d2b8940 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:57.884162 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-59472212-91e7-4cee-9344-23f1d413b421 req-8f87b124-90a8-41b0-a0c6-9d1a1d2b8940 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:57.896543 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-59472212-91e7-4cee-9344-23f1d413b421 req-8f87b124-90a8-41b0-a0c6-9d1a1d2b8940 service nova] Creating event network-vif-deleted:b93715cd-b844-448b-8661-4c58ce13542c for instance 6d93a166-e753-4779-bd52-67f67445c3c9 on hv-cinder-83090 May 13 15:03:57.905940 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-59472212-91e7-4cee-9344-23f1d413b421 req-8f87b124-90a8-41b0-a0c6-9d1a1d2b8940 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037867 May 13 15:03:57.907220 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 437/891] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:03:58.378160 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-465dd6db-bfda-4ede-a85c-acb29bc1599a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:58.378857 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-465dd6db-bfda-4ede-a85c-acb29bc1599a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:58.386114 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-465dd6db-bfda-4ede-a85c-acb29bc1599a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:58.386533 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-465dd6db-bfda-4ede-a85c-acb29bc1599a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:58.387360 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-465dd6db-bfda-4ede-a85c-acb29bc1599a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:58.387786 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-465dd6db-bfda-4ede-a85c-acb29bc1599a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:58.423187 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-465dd6db-bfda-4ede-a85c-acb29bc1599a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:58.423628 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-465dd6db-bfda-4ede-a85c-acb29bc1599a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:58.424205 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-465dd6db-bfda-4ede-a85c-acb29bc1599a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lazy-loading 'fault' on Instance uuid 6d93a166-e753-4779-bd52-67f67445c3c9 {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:03:58.484420 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-465dd6db-bfda-4ede-a85c-acb29bc1599a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbe6cc242fbf40cf8250dabaa336f648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '634e7491dc6e43f98fb82baba250b09b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:03:58.491635 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-465dd6db-bfda-4ede-a85c-acb29bc1599a tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 200 len: 1326 microversion: 2.1 time: 0.117329 May 13 15:03:58.492638 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 455/892] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:03:58 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 1326 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:03:59.512462 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-adb3b811-8dad-40c6-aad6-fb717eadb118 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:59.513153 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-adb3b811-8dad-40c6-aad6-fb717eadb118 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:03:59.521553 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-adb3b811-8dad-40c6-aad6-fb717eadb118 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:59.522148 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-adb3b811-8dad-40c6-aad6-fb717eadb118 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:59.523306 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-adb3b811-8dad-40c6-aad6-fb717eadb118 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:03:59.523895 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-adb3b811-8dad-40c6-aad6-fb717eadb118 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:03:59.538879 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-adb3b811-8dad-40c6-aad6-fb717eadb118 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] HTTP exception thrown: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-adb3b811-8dad-40c6-aad6-fb717eadb118 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Request method failure captured: May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 HTTP/1.1 May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnEUgwNuADqWE8tnVfUktdo9bbfNPZiyT_WOUx-UalXYA9DosMTf697mKThsqrWLYLjq5XxgrwZkLSqVtRuVNvD5QCJOY-w0-xiIargULPVZ9UJQPsXdHeELIvw5t7DWjJnvaNaBb69YHIhMaS8n9RGcQ3UEDVYcVb4gbhweiNpTKRo May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 634e7491dc6e43f98fb82baba250b09b May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-AttachVolumeTestJSON-207340798 May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:03:59.540587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:03:59.542327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_634e7491dc6e43f98fb82baba250b09b", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:03:59.542327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-AttachVolumeTestJSON-207340798 May 13 15:03:59.542327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 634e7491dc6e43f98fb82baba250b09b May 13 15:03:59.542327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-AttachVolumeTestJSON-207340798 May 13 15:03:59.542327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-AttachVolumeTestJSON-207340798-project May 13 15:03:59.542327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:03:59.542327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:03:59.542327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: fbe6cc242fbf40cf8250dabaa336f648 May 13 15:03:59.542327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-AttachVolumeTestJSON-207340798-project May 13 15:03:59.542327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 15:03:59.542327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. May 13 15:03:59.542327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': '6d93a166-e753-4779-bd52-67f67445c3c9'} May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:03:59.543174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. May 13 15:03:59.544703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:03:59.546208 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-adb3b811-8dad-40c6-aad6-fb717eadb118 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Returning 404 to user: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:03:59.546208 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-adb3b811-8dad-40c6-aad6-fb717eadb118 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 404 len: 111 microversion: 2.1 time: 0.034582 May 13 15:03:59.546208 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 438/893] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:03:59 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:03:59.551340 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c15f1fad-a1f2-4789-b936-0fed5ff4c426 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '.version_select at 0x7fcf4ca5f0d0>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:03:59.574204 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c15f1fad-a1f2-4789-b936-0fed5ff4c426 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-420527209" status: 202 len: 0 microversion: 2.1 time: 0.026669 May 13 15:03:59.574769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 456/894] 10.222.0.99 () {58 vars in 1217 bytes} [Fri May 13 15:03:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-420527209 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:04:02.501779 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-dba49e6a-3700-4c48-a84d-2a73d33d086b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:02.502633 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-dba49e6a-3700-4c48-a84d-2a73d33d086b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:02.509238 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dba49e6a-3700-4c48-a84d-2a73d33d086b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:02.509680 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dba49e6a-3700-4c48-a84d-2a73d33d086b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:02.510447 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dba49e6a-3700-4c48-a84d-2a73d33d086b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:02.510876 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dba49e6a-3700-4c48-a84d-2a73d33d086b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:02.525637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-dba49e6a-3700-4c48-a84d-2a73d33d086b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] HTTP exception thrown: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-dba49e6a-3700-4c48-a84d-2a73d33d086b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Request method failure captured: May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: DELETE /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 HTTP/1.1 May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnEUgwNuADqWE8tnVfUktdo9bbfNPZiyT_WOUx-UalXYA9DosMTf697mKThsqrWLYLjq5XxgrwZkLSqVtRuVNvD5QCJOY-w0-xiIargULPVZ9UJQPsXdHeELIvw5t7DWjJnvaNaBb69YHIhMaS8n9RGcQ3UEDVYcVb4gbhweiNpTKRo May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 634e7491dc6e43f98fb82baba250b09b May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-AttachVolumeTestJSON-207340798 May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:04:02.527233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:04:02.528882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_634e7491dc6e43f98fb82baba250b09b", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:02.528882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-AttachVolumeTestJSON-207340798 May 13 15:04:02.528882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 634e7491dc6e43f98fb82baba250b09b May 13 15:04:02.528882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-AttachVolumeTestJSON-207340798 May 13 15:04:02.528882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-AttachVolumeTestJSON-207340798-project May 13 15:04:02.528882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:04:02.528882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:04:02.528882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: fbe6cc242fbf40cf8250dabaa336f648 May 13 15:04:02.528882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-AttachVolumeTestJSON-207340798-project May 13 15:04:02.528882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 15:04:02.528882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. May 13 15:04:02.528882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': '6d93a166-e753-4779-bd52-67f67445c3c9'} May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:02.529722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. May 13 15:04:02.531161 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:02.533460 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-dba49e6a-3700-4c48-a84d-2a73d33d086b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Returning 404 to user: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:02.533460 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-dba49e6a-3700-4c48-a84d-2a73d33d086b tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "DELETE /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 404 len: 111 microversion: 2.1 time: 0.032103 May 13 15:04:02.533460 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 439/895] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:04:02 2022] DELETE /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:04:02.538223 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-342a6bd3-2c89-4102-9b47-6798f0b8e53d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:02.538836 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-342a6bd3-2c89-4102-9b47-6798f0b8e53d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 6d93a166-e753-4779-bd52-67f67445c3c9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:02.545852 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-342a6bd3-2c89-4102-9b47-6798f0b8e53d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:02.546301 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-342a6bd3-2c89-4102-9b47-6798f0b8e53d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:02.547074 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-342a6bd3-2c89-4102-9b47-6798f0b8e53d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:02.547568 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-342a6bd3-2c89-4102-9b47-6798f0b8e53d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:02.562444 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-342a6bd3-2c89-4102-9b47-6798f0b8e53d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] HTTP exception thrown: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-342a6bd3-2c89-4102-9b47-6798f0b8e53d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Request method failure captured: May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 HTTP/1.1 May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnEUgwNuADqWE8tnVfUktdo9bbfNPZiyT_WOUx-UalXYA9DosMTf697mKThsqrWLYLjq5XxgrwZkLSqVtRuVNvD5QCJOY-w0-xiIargULPVZ9UJQPsXdHeELIvw5t7DWjJnvaNaBb69YHIhMaS8n9RGcQ3UEDVYcVb4gbhweiNpTKRo May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 634e7491dc6e43f98fb82baba250b09b May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-AttachVolumeTestJSON-207340798 May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:04:02.564596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:04:02.566267 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_634e7491dc6e43f98fb82baba250b09b", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:02.566267 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-AttachVolumeTestJSON-207340798 May 13 15:04:02.566267 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 634e7491dc6e43f98fb82baba250b09b May 13 15:04:02.566267 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-AttachVolumeTestJSON-207340798 May 13 15:04:02.566267 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-AttachVolumeTestJSON-207340798-project May 13 15:04:02.566267 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:04:02.566267 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:04:02.566267 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: fbe6cc242fbf40cf8250dabaa336f648 May 13 15:04:02.566267 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-AttachVolumeTestJSON-207340798-project May 13 15:04:02.566267 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:04:02.566267 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. May 13 15:04:02.566267 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '6d93a166-e753-4779-bd52-67f67445c3c9'} May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:02.567373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. May 13 15:04:02.568849 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:02.570524 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-342a6bd3-2c89-4102-9b47-6798f0b8e53d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Returning 404 to user: Instance 6d93a166-e753-4779-bd52-67f67445c3c9 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:02.570524 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-342a6bd3-2c89-4102-9b47-6798f0b8e53d tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9" status: 404 len: 111 microversion: 2.1 time: 0.032288 May 13 15:04:02.570524 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 457/896] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:04:02 2022] GET /compute/v2.1/servers/6d93a166-e753-4779-bd52-67f67445c3c9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 15:04:03.719236 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f490a3bc-92fe-4303-b22f-f027546480c8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:03.719762 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f490a3bc-92fe-4303-b22f-f027546480c8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:03.727190 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f490a3bc-92fe-4303-b22f-f027546480c8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:03.727630 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f490a3bc-92fe-4303-b22f-f027546480c8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:03.728466 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f490a3bc-92fe-4303-b22f-f027546480c8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:03.728908 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f490a3bc-92fe-4303-b22f-f027546480c8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:03.742976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-f490a3bc-92fe-4303-b22f-f027546480c8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] HTTP exception thrown: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f490a3bc-92fe-4303-b22f-f027546480c8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Request method failure captured: May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: DELETE /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 HTTP/1.1 May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnEUgwNuADqWE8tnVfUktdo9bbfNPZiyT_WOUx-UalXYA9DosMTf697mKThsqrWLYLjq5XxgrwZkLSqVtRuVNvD5QCJOY-w0-xiIargULPVZ9UJQPsXdHeELIvw5t7DWjJnvaNaBb69YHIhMaS8n9RGcQ3UEDVYcVb4gbhweiNpTKRo May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 634e7491dc6e43f98fb82baba250b09b May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-AttachVolumeTestJSON-207340798 May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:04:03.744563 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:04:03.746092 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_634e7491dc6e43f98fb82baba250b09b", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:03.746092 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-AttachVolumeTestJSON-207340798 May 13 15:04:03.746092 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 634e7491dc6e43f98fb82baba250b09b May 13 15:04:03.746092 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-AttachVolumeTestJSON-207340798 May 13 15:04:03.746092 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-AttachVolumeTestJSON-207340798-project May 13 15:04:03.746092 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:04:03.746092 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:04:03.746092 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: fbe6cc242fbf40cf8250dabaa336f648 May 13 15:04:03.746092 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-AttachVolumeTestJSON-207340798-project May 13 15:04:03.746092 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 15:04:03.746092 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. May 13 15:04:03.746092 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': '37b68ffc-74f1-4850-ba58-9504e3b5c4c7'} May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:03.746947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. May 13 15:04:03.748435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:03.749854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f490a3bc-92fe-4303-b22f-f027546480c8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Returning 404 to user: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:03.749854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f490a3bc-92fe-4303-b22f-f027546480c8 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "DELETE /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 404 len: 111 microversion: 2.1 time: 0.032412 May 13 15:04:03.749854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 440/897] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:04:03 2022] DELETE /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:04:03.755333 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9496a491-7704-4ca5-a608-36e015326c99 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:03.756047 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9496a491-7704-4ca5-a608-36e015326c99 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] [instance: 37b68ffc-74f1-4850-ba58-9504e3b5c4c7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:03.762727 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9496a491-7704-4ca5-a608-36e015326c99 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:03.763174 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9496a491-7704-4ca5-a608-36e015326c99 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:03.763998 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9496a491-7704-4ca5-a608-36e015326c99 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:03.764440 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9496a491-7704-4ca5-a608-36e015326c99 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:03.778766 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-9496a491-7704-4ca5-a608-36e015326c99 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] HTTP exception thrown: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9496a491-7704-4ca5-a608-36e015326c99 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Request method failure captured: May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 HTTP/1.1 May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnEUgwNuADqWE8tnVfUktdo9bbfNPZiyT_WOUx-UalXYA9DosMTf697mKThsqrWLYLjq5XxgrwZkLSqVtRuVNvD5QCJOY-w0-xiIargULPVZ9UJQPsXdHeELIvw5t7DWjJnvaNaBb69YHIhMaS8n9RGcQ3UEDVYcVb4gbhweiNpTKRo May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 634e7491dc6e43f98fb82baba250b09b May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-AttachVolumeTestJSON-207340798 May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:04:03.780248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:04:03.781809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_634e7491dc6e43f98fb82baba250b09b", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/634e7491dc6e43f98fb82baba250b09b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:03.781809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-AttachVolumeTestJSON-207340798 May 13 15:04:03.781809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 634e7491dc6e43f98fb82baba250b09b May 13 15:04:03.781809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-AttachVolumeTestJSON-207340798 May 13 15:04:03.781809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-AttachVolumeTestJSON-207340798-project May 13 15:04:03.781809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:04:03.781809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:04:03.781809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: fbe6cc242fbf40cf8250dabaa336f648 May 13 15:04:03.781809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-AttachVolumeTestJSON-207340798-project May 13 15:04:03.781809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:04:03.781809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. May 13 15:04:03.781809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '37b68ffc-74f1-4850-ba58-9504e3b5c4c7'} May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:03.782600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. May 13 15:04:03.784136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:03.785434 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9496a491-7704-4ca5-a608-36e015326c99 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] Returning 404 to user: Instance 37b68ffc-74f1-4850-ba58-9504e3b5c4c7 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:03.785434 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9496a491-7704-4ca5-a608-36e015326c99 tempest-AttachVolumeTestJSON-207340798 tempest-AttachVolumeTestJSON-207340798-project] 10.222.0.99 "GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7" status: 404 len: 111 microversion: 2.1 time: 0.030349 May 13 15:04:03.785434 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 458/898] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:04:03 2022] GET /compute/v2.1/servers/37b68ffc-74f1-4850-ba58-9504e3b5c4c7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:04:08.369188 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-237c01bf-317c-4da5-9c8b-f67d4d6b3095 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:08.369783 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-237c01bf-317c-4da5-9c8b-f67d4d6b3095 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:08.375939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-237c01bf-317c-4da5-9c8b-f67d4d6b3095 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:08.376403 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-237c01bf-317c-4da5-9c8b-f67d4d6b3095 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:08.377373 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-237c01bf-317c-4da5-9c8b-f67d4d6b3095 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:08.378002 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-237c01bf-317c-4da5-9c8b-f67d4d6b3095 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:08.401125 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-237c01bf-317c-4da5-9c8b-f67d4d6b3095 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618/ips" status: 200 len: 149 microversion: 2.1 time: 0.035887 May 13 15:04:08.401804 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 441/899] 10.222.0.99 () {58 vars in 1247 bytes} [Fri May 13 15:04:08 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 15:04:09.748383 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-2638246f-4292-4782-9334-0b9cd5a5f4ea tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acf729b4-3599-4b13-b4ff-ce05873fccc1"}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:04:09.749458 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-2638246f-4292-4782-9334-0b9cd5a5f4ea tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:09.755950 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2638246f-4292-4782-9334-0b9cd5a5f4ea tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:09.756669 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2638246f-4292-4782-9334-0b9cd5a5f4ea tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:09.757465 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2638246f-4292-4782-9334-0b9cd5a5f4ea tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:09.758091 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2638246f-4292-4782-9334-0b9cd5a5f4ea tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:10.202196 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-2638246f-4292-4782-9334-0b9cd5a5f4ea tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "POST /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.457797 May 13 15:04:10.202813 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 459/900] 10.222.0.99 () {60 vars in 1322 bytes} [Fri May 13 15:04:09 2022] POST /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618/os-volume_attachments => generated 194 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:04:17.809104 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-0f8ff867-c4ba-485b-8ce4-06e6c1773fab tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:17.809597 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-0f8ff867-c4ba-485b-8ce4-06e6c1773fab tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:17.815740 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0f8ff867-c4ba-485b-8ce4-06e6c1773fab tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:17.816230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0f8ff867-c4ba-485b-8ce4-06e6c1773fab tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:17.817012 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0f8ff867-c4ba-485b-8ce4-06e6c1773fab tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:17.817497 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-0f8ff867-c4ba-485b-8ce4-06e6c1773fab tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:18.109206 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-0f8ff867-c4ba-485b-8ce4-06e6c1773fab tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lazy-loading 'services' on Instance uuid d0ebb1ba-c437-4742-be14-49a16452e618 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:04:18.182413 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-0f8ff867-c4ba-485b-8ce4-06e6c1773fab tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618/os-volume_attachments/acf729b4-3599-4b13-b4ff-ce05873fccc1" status: 202 len: 0 microversion: 2.1 time: 0.377089 May 13 15:04:18.182997 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 442/901] 10.222.0.99 () {58 vars in 1415 bytes} [Fri May 13 15:04:17 2022] DELETE /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618/os-volume_attachments/acf729b4-3599-4b13-b4ff-ce05873fccc1 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:04:18.193627 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d6fead9a-8be4-4d33-8ae3-550c9c04dc48 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:18.195144 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d6fead9a-8be4-4d33-8ae3-550c9c04dc48 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:18.202030 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d6fead9a-8be4-4d33-8ae3-550c9c04dc48 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:18.202475 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d6fead9a-8be4-4d33-8ae3-550c9c04dc48 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:18.203265 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d6fead9a-8be4-4d33-8ae3-550c9c04dc48 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:18.203674 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d6fead9a-8be4-4d33-8ae3-550c9c04dc48 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:18.234558 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d6fead9a-8be4-4d33-8ae3-550c9c04dc48 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046850 May 13 15:04:18.235432 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 460/902] 10.222.0.99 () {58 vars in 1301 bytes} [Fri May 13 15:04:18 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 15:04:19.248884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-33ab4c35-4a04-4e8a-9272-5f502cbb44e8 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:19.249976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-33ab4c35-4a04-4e8a-9272-5f502cbb44e8 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:19.257510 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-33ab4c35-4a04-4e8a-9272-5f502cbb44e8 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:19.257951 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-33ab4c35-4a04-4e8a-9272-5f502cbb44e8 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:19.258766 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-33ab4c35-4a04-4e8a-9272-5f502cbb44e8 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:19.259146 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-33ab4c35-4a04-4e8a-9272-5f502cbb44e8 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:19.290997 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-33ab4c35-4a04-4e8a-9272-5f502cbb44e8 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046935 May 13 15:04:19.291596 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 443/903] 10.222.0.99 () {58 vars in 1301 bytes} [Fri May 13 15:04:19 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 15:04:19.355861 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-6113eb01-89f5-450a-8ef5-39056de15734 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:19.356462 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-6113eb01-89f5-450a-8ef5-39056de15734 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:19.363428 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6113eb01-89f5-450a-8ef5-39056de15734 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:19.363859 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6113eb01-89f5-450a-8ef5-39056de15734 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:19.364741 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6113eb01-89f5-450a-8ef5-39056de15734 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:19.365176 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6113eb01-89f5-450a-8ef5-39056de15734 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:19.394538 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-6113eb01-89f5-450a-8ef5-39056de15734 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Going to try to terminate instance {{(pid=117295) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 15:04:19.486672 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-6113eb01-89f5-450a-8ef5-39056de15734 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 204 len: 0 microversion: 2.1 time: 0.134481 May 13 15:04:19.487280 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 461/904] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:04:19 2022] DELETE /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 15:04:19.496467 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c0dd0c66-c450-4824-bc9b-521725cdfe72 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:19.497187 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c0dd0c66-c450-4824-bc9b-521725cdfe72 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:19.503842 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c0dd0c66-c450-4824-bc9b-521725cdfe72 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:19.504389 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c0dd0c66-c450-4824-bc9b-521725cdfe72 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:19.505513 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c0dd0c66-c450-4824-bc9b-521725cdfe72 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:19.505985 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c0dd0c66-c450-4824-bc9b-521725cdfe72 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:19.655783 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c0dd0c66-c450-4824-bc9b-521725cdfe72 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:04:19.666030 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c0dd0c66-c450-4824-bc9b-521725cdfe72 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 200 len: 1681 microversion: 2.1 time: 0.173926 May 13 15:04:19.675670 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 444/905] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:04:19 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:04:20.685137 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-fe03e7d1-1d0c-4b96-aced-f26597015694 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:20.685839 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-fe03e7d1-1d0c-4b96-aced-f26597015694 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:20.697483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fe03e7d1-1d0c-4b96-aced-f26597015694 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:20.697933 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fe03e7d1-1d0c-4b96-aced-f26597015694 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:20.700290 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fe03e7d1-1d0c-4b96-aced-f26597015694 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:20.700741 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fe03e7d1-1d0c-4b96-aced-f26597015694 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:20.858911 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-fe03e7d1-1d0c-4b96-aced-f26597015694 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:04:20.867546 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-fe03e7d1-1d0c-4b96-aced-f26597015694 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 200 len: 1681 microversion: 2.1 time: 0.187418 May 13 15:04:20.868214 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 462/906] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:04:20 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:04:21.889350 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ccb30552-7886-4d89-bfd9-d3ea2f1d9977 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:21.890930 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ccb30552-7886-4d89-bfd9-d3ea2f1d9977 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:21.900292 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ccb30552-7886-4d89-bfd9-d3ea2f1d9977 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:21.900845 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ccb30552-7886-4d89-bfd9-d3ea2f1d9977 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:21.902260 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ccb30552-7886-4d89-bfd9-d3ea2f1d9977 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:21.902871 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ccb30552-7886-4d89-bfd9-d3ea2f1d9977 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:22.044410 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ccb30552-7886-4d89-bfd9-d3ea2f1d9977 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:04:22.051855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ccb30552-7886-4d89-bfd9-d3ea2f1d9977 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 200 len: 1681 microversion: 2.1 time: 0.166539 May 13 15:04:22.052469 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 445/907] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:04:21 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:04:22.562006 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-30a97bb6-578b-44ff-91cc-fbe495d769bc req-e7be4848-d38c-476c-a74d-3d69f9071c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ebb1ba-c437-4742-be14-49a16452e618", "name": "network-vif-deleted", "tag": "913713f9-227c-453c-8a43-d81597fa8d48"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:04:22.576088 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-30a97bb6-578b-44ff-91cc-fbe495d769bc req-e7be4848-d38c-476c-a74d-3d69f9071c87 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:22.576862 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-30a97bb6-578b-44ff-91cc-fbe495d769bc req-e7be4848-d38c-476c-a74d-3d69f9071c87 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:22.597767 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-30a97bb6-578b-44ff-91cc-fbe495d769bc req-e7be4848-d38c-476c-a74d-3d69f9071c87 service nova] Creating event network-vif-deleted:913713f9-227c-453c-8a43-d81597fa8d48 for instance d0ebb1ba-c437-4742-be14-49a16452e618 on hv-cinder-83090 May 13 15:04:22.605304 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-30a97bb6-578b-44ff-91cc-fbe495d769bc req-e7be4848-d38c-476c-a74d-3d69f9071c87 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047301 May 13 15:04:22.606211 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 463/908] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:04:23.069366 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f91dfdfc-4d72-40a8-abb5-6fc8297e453f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:23.070763 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f91dfdfc-4d72-40a8-abb5-6fc8297e453f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:23.077674 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f91dfdfc-4d72-40a8-abb5-6fc8297e453f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:23.078396 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f91dfdfc-4d72-40a8-abb5-6fc8297e453f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:23.079191 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f91dfdfc-4d72-40a8-abb5-6fc8297e453f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:23.079607 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f91dfdfc-4d72-40a8-abb5-6fc8297e453f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:23.120459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f91dfdfc-4d72-40a8-abb5-6fc8297e453f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:23.120927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f91dfdfc-4d72-40a8-abb5-6fc8297e453f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:23.121369 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-f91dfdfc-4d72-40a8-abb5-6fc8297e453f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lazy-loading 'fault' on Instance uuid d0ebb1ba-c437-4742-be14-49a16452e618 {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:04:23.172511 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f91dfdfc-4d72-40a8-abb5-6fc8297e453f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ded6e90b10949dcb921119073f2d26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ff6bdb0a99948698dc413c12b120b61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:04:23.180019 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f91dfdfc-4d72-40a8-abb5-6fc8297e453f tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 200 len: 1332 microversion: 2.1 time: 0.114458 May 13 15:04:23.180873 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 446/909] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:04:23 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:04:24.198863 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-688865be-3783-4fd3-9556-6002dfdf80f5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:24.199534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-688865be-3783-4fd3-9556-6002dfdf80f5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:24.206586 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-688865be-3783-4fd3-9556-6002dfdf80f5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:24.207036 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-688865be-3783-4fd3-9556-6002dfdf80f5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:24.207809 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-688865be-3783-4fd3-9556-6002dfdf80f5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:24.208280 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-688865be-3783-4fd3-9556-6002dfdf80f5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:24.222081 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-688865be-3783-4fd3-9556-6002dfdf80f5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] HTTP exception thrown: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-688865be-3783-4fd3-9556-6002dfdf80f5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Request method failure captured: May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 HTTP/1.1 May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnETlq5ud0tLso0I4BZTgYxPV45uNUu133mcSZWQF8BrY5W-G7qjq44vNdtUOkhBY1NV_9YSUowwjJ-SwPRew__XdEJEaAD7-9rhSJZVxBqaksNyEovGIgePKTwhLV_b-Jq67lITHd9QMI2kWMsWgOPV6MBxPM4K-LIG_E6GaM8BRTg May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:04:24.223716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:04:24.225685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8ff6bdb0a99948698dc413c12b120b61", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:24.225685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:24.225685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:24.225685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:24.225685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:24.225685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:04:24.225685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:04:24.225685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 1ded6e90b10949dcb921119073f2d26a May 13 15:04:24.225685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:24.225685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:04:24.225685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. May 13 15:04:24.225685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': 'd0ebb1ba-c437-4742-be14-49a16452e618'} May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:24.226769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. May 13 15:04:24.228474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:24.230023 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-688865be-3783-4fd3-9556-6002dfdf80f5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Returning 404 to user: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:24.230023 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-688865be-3783-4fd3-9556-6002dfdf80f5 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 404 len: 111 microversion: 2.1 time: 0.030743 May 13 15:04:24.230023 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 464/910] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:04:24 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:04:24.235325 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c5e56912-29c4-4751-a71f-df10bb678973 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '.version_select at 0x7fcf4805e040>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:24.256520 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c5e56912-29c4-4751-a71f-df10bb678973 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973660048" status: 202 len: 0 microversion: 2.1 time: 0.025172 May 13 15:04:24.257109 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 447/911] 10.222.0.99 () {58 vars in 1220 bytes} [Fri May 13 15:04:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1973660048 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:04:26.062246 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-eb279850-4b17-4ae1-81bc-ba5f434d1574 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:26.062851 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-eb279850-4b17-4ae1-81bc-ba5f434d1574 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:26.069593 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-eb279850-4b17-4ae1-81bc-ba5f434d1574 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:26.070044 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-eb279850-4b17-4ae1-81bc-ba5f434d1574 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:26.070946 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-eb279850-4b17-4ae1-81bc-ba5f434d1574 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:26.071478 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-eb279850-4b17-4ae1-81bc-ba5f434d1574 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:26.087638 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-eb279850-4b17-4ae1-81bc-ba5f434d1574 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] HTTP exception thrown: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-eb279850-4b17-4ae1-81bc-ba5f434d1574 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Request method failure captured: May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: DELETE /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 HTTP/1.1 May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnETlq5ud0tLso0I4BZTgYxPV45uNUu133mcSZWQF8BrY5W-G7qjq44vNdtUOkhBY1NV_9YSUowwjJ-SwPRew__XdEJEaAD7-9rhSJZVxBqaksNyEovGIgePKTwhLV_b-Jq67lITHd9QMI2kWMsWgOPV6MBxPM4K-LIG_E6GaM8BRTg May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:04:26.089302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:04:26.090765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8ff6bdb0a99948698dc413c12b120b61", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:26.090765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:26.090765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:26.090765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:26.090765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:26.090765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:04:26.090765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:04:26.090765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 1ded6e90b10949dcb921119073f2d26a May 13 15:04:26.090765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:26.090765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:04:26.090765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. May 13 15:04:26.090765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': 'd0ebb1ba-c437-4742-be14-49a16452e618'} May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:26.091608 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. May 13 15:04:26.092930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:26.094227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-eb279850-4b17-4ae1-81bc-ba5f434d1574 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Returning 404 to user: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:26.094227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-eb279850-4b17-4ae1-81bc-ba5f434d1574 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 404 len: 111 microversion: 2.1 time: 0.033122 May 13 15:04:26.094227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 465/912] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:04:26 2022] DELETE /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:04:26.100316 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-54ed0448-b7ee-40b4-a72c-e2519f738c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:26.100965 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-54ed0448-b7ee-40b4-a72c-e2519f738c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: d0ebb1ba-c437-4742-be14-49a16452e618] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:26.108681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-54ed0448-b7ee-40b4-a72c-e2519f738c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:26.109134 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-54ed0448-b7ee-40b4-a72c-e2519f738c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:26.109916 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-54ed0448-b7ee-40b4-a72c-e2519f738c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:26.110322 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-54ed0448-b7ee-40b4-a72c-e2519f738c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:26.124887 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-54ed0448-b7ee-40b4-a72c-e2519f738c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] HTTP exception thrown: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-54ed0448-b7ee-40b4-a72c-e2519f738c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Request method failure captured: May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 HTTP/1.1 May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnETlq5ud0tLso0I4BZTgYxPV45uNUu133mcSZWQF8BrY5W-G7qjq44vNdtUOkhBY1NV_9YSUowwjJ-SwPRew__XdEJEaAD7-9rhSJZVxBqaksNyEovGIgePKTwhLV_b-Jq67lITHd9QMI2kWMsWgOPV6MBxPM4K-LIG_E6GaM8BRTg May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:04:26.126477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:04:26.128210 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8ff6bdb0a99948698dc413c12b120b61", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:26.128210 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:26.128210 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:26.128210 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:26.128210 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:26.128210 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:04:26.128210 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:04:26.128210 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: 1ded6e90b10949dcb921119073f2d26a May 13 15:04:26.128210 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:26.128210 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 15:04:26.128210 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. May 13 15:04:26.128210 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': 'd0ebb1ba-c437-4742-be14-49a16452e618'} May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:26.129000 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. May 13 15:04:26.130229 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:26.131352 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-54ed0448-b7ee-40b4-a72c-e2519f738c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Returning 404 to user: Instance d0ebb1ba-c437-4742-be14-49a16452e618 could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:26.131352 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-54ed0448-b7ee-40b4-a72c-e2519f738c4e tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618" status: 404 len: 111 microversion: 2.1 time: 0.032411 May 13 15:04:26.131352 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 448/913] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:04:26 2022] GET /compute/v2.1/servers/d0ebb1ba-c437-4742-be14-49a16452e618 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:04:27.276235 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-94441f53-7df6-40fc-8c34-fa38af027b8a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:27.276789 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-94441f53-7df6-40fc-8c34-fa38af027b8a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:27.283600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-94441f53-7df6-40fc-8c34-fa38af027b8a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:27.284079 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-94441f53-7df6-40fc-8c34-fa38af027b8a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:27.284847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-94441f53-7df6-40fc-8c34-fa38af027b8a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:27.285279 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-94441f53-7df6-40fc-8c34-fa38af027b8a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:27.299288 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-94441f53-7df6-40fc-8c34-fa38af027b8a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] HTTP exception thrown: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-94441f53-7df6-40fc-8c34-fa38af027b8a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Request method failure captured: May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: DELETE /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 HTTP/1.1 May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnETlq5ud0tLso0I4BZTgYxPV45uNUu133mcSZWQF8BrY5W-G7qjq44vNdtUOkhBY1NV_9YSUowwjJ-SwPRew__XdEJEaAD7-9rhSJZVxBqaksNyEovGIgePKTwhLV_b-Jq67lITHd9QMI2kWMsWgOPV6MBxPM4K-LIG_E6GaM8BRTg May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:04:27.300891 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:04:27.302483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8ff6bdb0a99948698dc413c12b120b61", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:27.302483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:27.302483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:27.302483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:27.302483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:27.302483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:04:27.302483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:04:27.302483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 1ded6e90b10949dcb921119073f2d26a May 13 15:04:27.302483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:27.302483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:04:27.302483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. May 13 15:04:27.302483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': 'cf1ec1b0-5a88-48de-8329-bd0b9792b8d5'} May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:27.303325 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. May 13 15:04:27.304777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:27.306312 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-94441f53-7df6-40fc-8c34-fa38af027b8a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Returning 404 to user: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:27.306312 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-94441f53-7df6-40fc-8c34-fa38af027b8a tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "DELETE /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 404 len: 111 microversion: 2.1 time: 0.030038 May 13 15:04:27.306312 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 466/914] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:04:27 2022] DELETE /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:04:27.310909 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-2c8db0c7-3ab0-4958-a243-620b501b6777 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:27.311515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-2c8db0c7-3ab0-4958-a243-620b501b6777 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: cf1ec1b0-5a88-48de-8329-bd0b9792b8d5] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:27.318315 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2c8db0c7-3ab0-4958-a243-620b501b6777 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:27.318759 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2c8db0c7-3ab0-4958-a243-620b501b6777 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:27.319594 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2c8db0c7-3ab0-4958-a243-620b501b6777 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:27.320057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2c8db0c7-3ab0-4958-a243-620b501b6777 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:27.333308 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-2c8db0c7-3ab0-4958-a243-620b501b6777 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] HTTP exception thrown: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-2c8db0c7-3ab0-4958-a243-620b501b6777 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Request method failure captured: May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 HTTP/1.1 May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnETlq5ud0tLso0I4BZTgYxPV45uNUu133mcSZWQF8BrY5W-G7qjq44vNdtUOkhBY1NV_9YSUowwjJ-SwPRew__XdEJEaAD7-9rhSJZVxBqaksNyEovGIgePKTwhLV_b-Jq67lITHd9QMI2kWMsWgOPV6MBxPM4K-LIG_E6GaM8BRTg May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:04:27.334923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:04:27.336515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8ff6bdb0a99948698dc413c12b120b61", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:27.336515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:27.336515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:27.336515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:27.336515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:27.336515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:04:27.336515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:04:27.336515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: 1ded6e90b10949dcb921119073f2d26a May 13 15:04:27.336515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:27.336515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 15:04:27.336515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. May 13 15:04:27.336515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': 'cf1ec1b0-5a88-48de-8329-bd0b9792b8d5'} May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:27.337461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. May 13 15:04:27.339230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:27.340575 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-2c8db0c7-3ab0-4958-a243-620b501b6777 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Returning 404 to user: Instance cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:27.340575 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-2c8db0c7-3ab0-4958-a243-620b501b6777 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5" status: 404 len: 111 microversion: 2.1 time: 0.029250 May 13 15:04:27.340575 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 449/915] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:04:27 2022] GET /compute/v2.1/servers/cf1ec1b0-5a88-48de-8329-bd0b9792b8d5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:04:27.346366 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-62b90ca4-47e0-4b44-873a-bfd272f41f32 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:27.346865 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-62b90ca4-47e0-4b44-873a-bfd272f41f32 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:27.354038 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-62b90ca4-47e0-4b44-873a-bfd272f41f32 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:27.354499 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-62b90ca4-47e0-4b44-873a-bfd272f41f32 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:27.355286 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-62b90ca4-47e0-4b44-873a-bfd272f41f32 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:27.355727 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-62b90ca4-47e0-4b44-873a-bfd272f41f32 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:27.371001 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-62b90ca4-47e0-4b44-873a-bfd272f41f32 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] HTTP exception thrown: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-62b90ca4-47e0-4b44-873a-bfd272f41f32 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Request method failure captured: May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: DELETE /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 HTTP/1.1 May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnETlq5ud0tLso0I4BZTgYxPV45uNUu133mcSZWQF8BrY5W-G7qjq44vNdtUOkhBY1NV_9YSUowwjJ-SwPRew__XdEJEaAD7-9rhSJZVxBqaksNyEovGIgePKTwhLV_b-Jq67lITHd9QMI2kWMsWgOPV6MBxPM4K-LIG_E6GaM8BRTg May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:04:27.372683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:04:27.374245 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8ff6bdb0a99948698dc413c12b120b61", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:27.374245 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:27.374245 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:27.374245 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:27.374245 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:27.374245 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:04:27.374245 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:04:27.374245 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 1ded6e90b10949dcb921119073f2d26a May 13 15:04:27.374245 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:27.374245 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:04:27.374245 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. May 13 15:04:27.374245 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '8ea83690-7cf5-475e-9339-4bf228b48893'} May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:27.375149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. May 13 15:04:27.376569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:27.378020 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-62b90ca4-47e0-4b44-873a-bfd272f41f32 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Returning 404 to user: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:27.378020 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-62b90ca4-47e0-4b44-873a-bfd272f41f32 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "DELETE /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 404 len: 111 microversion: 2.1 time: 0.031785 May 13 15:04:27.378020 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 467/916] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:04:27 2022] DELETE /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:04:27.386670 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-31f9fd1f-c641-4099-8aff-4bce53f2740b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:27.387281 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-31f9fd1f-c641-4099-8aff-4bce53f2740b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 8ea83690-7cf5-475e-9339-4bf228b48893] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:27.393430 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-31f9fd1f-c641-4099-8aff-4bce53f2740b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:27.393881 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-31f9fd1f-c641-4099-8aff-4bce53f2740b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:27.394676 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-31f9fd1f-c641-4099-8aff-4bce53f2740b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:27.395207 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-31f9fd1f-c641-4099-8aff-4bce53f2740b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:27.408835 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-31f9fd1f-c641-4099-8aff-4bce53f2740b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] HTTP exception thrown: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-31f9fd1f-c641-4099-8aff-4bce53f2740b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Request method failure captured: May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 HTTP/1.1 May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnETlq5ud0tLso0I4BZTgYxPV45uNUu133mcSZWQF8BrY5W-G7qjq44vNdtUOkhBY1NV_9YSUowwjJ-SwPRew__XdEJEaAD7-9rhSJZVxBqaksNyEovGIgePKTwhLV_b-Jq67lITHd9QMI2kWMsWgOPV6MBxPM4K-LIG_E6GaM8BRTg May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:04:27.410358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:04:27.411818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8ff6bdb0a99948698dc413c12b120b61", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:27.411818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:27.411818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:27.411818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:27.411818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:27.411818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:04:27.411818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:04:27.411818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: 1ded6e90b10949dcb921119073f2d26a May 13 15:04:27.411818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:27.411818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 15:04:27.411818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. May 13 15:04:27.411818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': '8ea83690-7cf5-475e-9339-4bf228b48893'} May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:27.412836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. May 13 15:04:27.414704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:27.416623 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-31f9fd1f-c641-4099-8aff-4bce53f2740b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Returning 404 to user: Instance 8ea83690-7cf5-475e-9339-4bf228b48893 could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:27.416623 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-31f9fd1f-c641-4099-8aff-4bce53f2740b tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893" status: 404 len: 111 microversion: 2.1 time: 0.029089 May 13 15:04:27.416623 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 450/917] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:04:27 2022] GET /compute/v2.1/servers/8ea83690-7cf5-475e-9339-4bf228b48893 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:04:28.550291 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-948902d6-387f-4ae1-9670-45bf35f94566 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:28.550977 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-948902d6-387f-4ae1-9670-45bf35f94566 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:28.558078 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-948902d6-387f-4ae1-9670-45bf35f94566 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:28.558553 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-948902d6-387f-4ae1-9670-45bf35f94566 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:28.559346 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-948902d6-387f-4ae1-9670-45bf35f94566 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:28.559799 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-948902d6-387f-4ae1-9670-45bf35f94566 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:28.574426 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-948902d6-387f-4ae1-9670-45bf35f94566 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] HTTP exception thrown: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-948902d6-387f-4ae1-9670-45bf35f94566 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Request method failure captured: May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: DELETE /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 HTTP/1.1 May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnETlq5ud0tLso0I4BZTgYxPV45uNUu133mcSZWQF8BrY5W-G7qjq44vNdtUOkhBY1NV_9YSUowwjJ-SwPRew__XdEJEaAD7-9rhSJZVxBqaksNyEovGIgePKTwhLV_b-Jq67lITHd9QMI2kWMsWgOPV6MBxPM4K-LIG_E6GaM8BRTg May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:04:28.576025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:04:28.577675 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8ff6bdb0a99948698dc413c12b120b61", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:28.577675 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:28.577675 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:28.577675 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:28.577675 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:28.577675 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:04:28.577675 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:04:28.577675 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 1ded6e90b10949dcb921119073f2d26a May 13 15:04:28.577675 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:28.577675 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:04:28.577675 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. May 13 15:04:28.577675 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '137f45b0-0ba4-4c2e-8588-b45112a1c7d7'} May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:28.578567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. May 13 15:04:28.579982 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:28.581801 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-948902d6-387f-4ae1-9670-45bf35f94566 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Returning 404 to user: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:28.581801 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-948902d6-387f-4ae1-9670-45bf35f94566 tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "DELETE /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 404 len: 111 microversion: 2.1 time: 0.031019 May 13 15:04:28.581801 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 468/918] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:04:28 2022] DELETE /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:04:28.586536 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-89d4d17a-6cd3-4ab9-8036-6e8163ef74da tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:28.587146 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-89d4d17a-6cd3-4ab9-8036-6e8163ef74da tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] [instance: 137f45b0-0ba4-4c2e-8588-b45112a1c7d7] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:04:28.593785 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-89d4d17a-6cd3-4ab9-8036-6e8163ef74da tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:28.594238 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-89d4d17a-6cd3-4ab9-8036-6e8163ef74da tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:28.595009 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-89d4d17a-6cd3-4ab9-8036-6e8163ef74da tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:04:28.595442 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-89d4d17a-6cd3-4ab9-8036-6e8163ef74da tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:04:28.609758 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-89d4d17a-6cd3-4ab9-8036-6e8163ef74da tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] HTTP exception thrown: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-89d4d17a-6cd3-4ab9-8036-6e8163ef74da tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Request method failure captured: May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 HTTP/1.1 May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnETlq5ud0tLso0I4BZTgYxPV45uNUu133mcSZWQF8BrY5W-G7qjq44vNdtUOkhBY1NV_9YSUowwjJ-SwPRew__XdEJEaAD7-9rhSJZVxBqaksNyEovGIgePKTwhLV_b-Jq67lITHd9QMI2kWMsWgOPV6MBxPM4K-LIG_E6GaM8BRTg May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:04:28.611293 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:04:28.612949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_8ff6bdb0a99948698dc413c12b120b61", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/8ff6bdb0a99948698dc413c12b120b61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:28.612949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:28.612949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 8ff6bdb0a99948698dc413c12b120b61 May 13 15:04:28.612949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1195141147 May 13 15:04:28.612949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:28.612949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:04:28.612949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:04:28.612949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: 1ded6e90b10949dcb921119073f2d26a May 13 15:04:28.612949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-AttachVolumeNegativeTest-1195141147-project May 13 15:04:28.612949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 15:04:28.612949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. May 13 15:04:28.612949 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': '137f45b0-0ba4-4c2e-8588-b45112a1c7d7'} May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:28.613826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. May 13 15:04:28.615256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:28.616812 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-89d4d17a-6cd3-4ab9-8036-6e8163ef74da tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] Returning 404 to user: Instance 137f45b0-0ba4-4c2e-8588-b45112a1c7d7 could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:28.616812 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-89d4d17a-6cd3-4ab9-8036-6e8163ef74da tempest-AttachVolumeNegativeTest-1195141147 tempest-AttachVolumeNegativeTest-1195141147-project] 10.222.0.99 "GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7" status: 404 len: 111 microversion: 2.1 time: 0.030153 May 13 15:04:28.616812 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 451/919] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:04:28 2022] GET /compute/v2.1/servers/137f45b0-0ba4-4c2e-8588-b45112a1c7d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:04:33.304420 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-8c30bcf6-7286-47b3-b04f-09eaaca006a1 tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Action: 'create', calling method: .version_select at 0x7fcf4ca95310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1997093137", "metadata": {"Type": "work"}}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-8c30bcf6-7286-47b3-b04f-09eaaca006a1 tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Request method failure captured: May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 122 May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnOBDBSNW2N1AvY8fuh-bBb-CzOLkHpZB6pe9zPjsao7TQSI3hUI184Q0M_sTSZ1lYirfB9k-f8muopnbnBPkBBlZQT3XRw1nbLE6MuUafKAREBnvns6c3d2GQ-9cl5VIGRsLA7tUby7D64sNYf8bq5hdDw1raPk7hFpESVHJYKCLBc May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 3071efd93e1747bbb2ba7f5bfdb5464a May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:04:33.314017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:04:33.316351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3071efd93e1747bbb2ba7f5bfdb5464a", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:33.316351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.316351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 3071efd93e1747bbb2ba7f5bfdb5464a May 13 15:04:33.316351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.316351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-VolumesNegativeTest-232099936-project May 13 15:04:33.316351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:04:33.316351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:04:33.316351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 8b9bf8ffc56140849ed6a162de4bca39 May 13 15:04:33.316351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-VolumesNegativeTest-232099936-project May 13 15:04:33.316351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: May 13 15:04:33.316351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1997093137", "metadata": {"Type": "work"}}} May 13 15:04:33.316351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: May 13 15:04:33.316351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1997093137', 'metadata': {'Type': 'work'}}}} May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise error May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi '#$%' May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:33.317710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 15:04:33.320031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 15:04:33.321333 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 15:04:33.321333 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.321333 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-8c30bcf6-7286-47b3-b04f-09eaaca006a1 tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:33.321333 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-8c30bcf6-7286-47b3-b04f-09eaaca006a1 tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.141544 May 13 15:04:33.321333 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 469/920] 10.222.0.99 () {60 vars in 1155 bytes} [Fri May 13 15:04:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 15:04:33.326894 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cc28438e-b50a-4a1d-9960-83a80c75fddd tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Action: 'create', calling method: .version_select at 0x7fcf4805e9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1804164589", "metadata": {"Type": "work"}}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cc28438e-b50a-4a1d-9960-83a80c75fddd tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Request method failure captured: May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 120 May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnOBDBSNW2N1AvY8fuh-bBb-CzOLkHpZB6pe9zPjsao7TQSI3hUI184Q0M_sTSZ1lYirfB9k-f8muopnbnBPkBBlZQT3XRw1nbLE6MuUafKAREBnvns6c3d2GQ-9cl5VIGRsLA7tUby7D64sNYf8bq5hdDw1raPk7hFpESVHJYKCLBc May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 3071efd93e1747bbb2ba7f5bfdb5464a May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:04:33.330072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:04:33.331779 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3071efd93e1747bbb2ba7f5bfdb5464a", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:33.331779 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.331779 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 3071efd93e1747bbb2ba7f5bfdb5464a May 13 15:04:33.331779 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.331779 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-VolumesNegativeTest-232099936-project May 13 15:04:33.331779 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:04:33.331779 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:04:33.331779 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: 8b9bf8ffc56140849ed6a162de4bca39 May 13 15:04:33.331779 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-VolumesNegativeTest-232099936-project May 13 15:04:33.331779 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: May 13 15:04:33.331779 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1804164589", "metadata": {"Type": "work"}}} May 13 15:04:33.331779 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: May 13 15:04:33.331779 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1804164589', 'metadata': {'Type': 'work'}}}} May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise error May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi '0' May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:33.333163 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 15:04:33.335128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 15:04:33.336841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 15:04:33.336841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.336841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cc28438e-b50a-4a1d-9960-83a80c75fddd tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:33.336841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-cc28438e-b50a-4a1d-9960-83a80c75fddd tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008585 May 13 15:04:33.336841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 452/921] 10.222.0.99 () {60 vars in 1155 bytes} [Fri May 13 15:04:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 15:04:33.342474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ca53ca4e-a888-40b2-be63-e082dfc62f9e tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Action: 'create', calling method: .version_select at 0x7fcf4c9f4e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-128253926", "metadata": {"Type": "work"}}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ca53ca4e-a888-40b2-be63-e082dfc62f9e tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Request method failure captured: May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 118 May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnOBDBSNW2N1AvY8fuh-bBb-CzOLkHpZB6pe9zPjsao7TQSI3hUI184Q0M_sTSZ1lYirfB9k-f8muopnbnBPkBBlZQT3XRw1nbLE6MuUafKAREBnvns6c3d2GQ-9cl5VIGRsLA7tUby7D64sNYf8bq5hdDw1raPk7hFpESVHJYKCLBc May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 3071efd93e1747bbb2ba7f5bfdb5464a May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:04:33.345630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:04:33.347190 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3071efd93e1747bbb2ba7f5bfdb5464a", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:33.347190 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.347190 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 3071efd93e1747bbb2ba7f5bfdb5464a May 13 15:04:33.347190 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.347190 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-VolumesNegativeTest-232099936-project May 13 15:04:33.347190 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:04:33.347190 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:04:33.347190 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 8b9bf8ffc56140849ed6a162de4bca39 May 13 15:04:33.347190 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-VolumesNegativeTest-232099936-project May 13 15:04:33.347190 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: May 13 15:04:33.347190 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-128253926", "metadata": {"Type": "work"}}} May 13 15:04:33.347190 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: May 13 15:04:33.347190 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-128253926', 'metadata': {'Type': 'work'}}}} May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise error May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi '' May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:33.348302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 15:04:33.350227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 15:04:33.351636 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 15:04:33.351636 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.351636 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ca53ca4e-a888-40b2-be63-e082dfc62f9e tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:33.351636 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ca53ca4e-a888-40b2-be63-e082dfc62f9e tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009075 May 13 15:04:33.351636 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 470/922] 10.222.0.99 () {60 vars in 1155 bytes} [Fri May 13 15:04:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 15:04:33.357391 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b6df4443-c95e-4be5-8b98-b32d10f93c32 tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Calling method '.version_select at 0x7fcf4cbaf040>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:33.385466 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-b6df4443-c95e-4be5-8b98-b32d10f93c32 tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] HTTP exception thrown: Volume tempest-invalid-1660183957 could not be found. May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b6df4443-c95e-4be5-8b98-b32d10f93c32 tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Request method failure captured: May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1660183957 HTTP/1.1 May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnOBDBSNW2N1AvY8fuh-bBb-CzOLkHpZB6pe9zPjsao7TQSI3hUI184Q0M_sTSZ1lYirfB9k-f8muopnbnBPkBBlZQT3XRw1nbLE6MuUafKAREBnvns6c3d2GQ-9cl5VIGRsLA7tUby7D64sNYf8bq5hdDw1raPk7hFpESVHJYKCLBc May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 3071efd93e1747bbb2ba7f5bfdb5464a May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:04:33.387435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:04:33.389057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3071efd93e1747bbb2ba7f5bfdb5464a", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:33.389057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.389057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 3071efd93e1747bbb2ba7f5bfdb5464a May 13 15:04:33.389057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.389057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-VolumesNegativeTest-232099936-project May 13 15:04:33.389057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:04:33.389057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:04:33.389057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: 8b9bf8ffc56140849ed6a162de4bca39 May 13 15:04:33.389057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-VolumesNegativeTest-232099936-project May 13 15:04:33.389057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: May 13 15:04:33.389057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Volume tempest-invalid-1660183957 could not be found. May 13 15:04:33.389057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': 'tempest-invalid-1660183957'} May 13 15:04:33.389057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1660183957 could not be found. (HTTP 404) (Request-ID: req-28d5feed-5476-49a4-a414-d956277afe79) May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:33.389942 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 15:04:33.391270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1660183957 could not be found. May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:04:33.393841 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1660183957 could not be found. May 13 15:04:33.395269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.395269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:33.395269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.395269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.395269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:33.395269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:33.395269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:04:33.395269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:04:33.395269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1660183957 could not be found. May 13 15:04:33.395269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.395269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b6df4443-c95e-4be5-8b98-b32d10f93c32 tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Returning 404 to user: Volume tempest-invalid-1660183957 could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:33.395269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b6df4443-c95e-4be5-8b98-b32d10f93c32 tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1660183957" status: 404 len: 99 microversion: 2.1 time: 0.035847 May 13 15:04:33.395269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 453/923] 10.222.0.99 () {58 vars in 1217 bytes} [Fri May 13 15:04:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1660183957 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 13 15:04:33.398172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-1bf992ce-891f-49bd-8027-049cc863b631 tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003751 May 13 15:04:33.398658 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 471/924] 10.222.0.99 () {58 vars in 1139 bytes} [Fri May 13 15:04:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 13 15:04:33.406712 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-be72b657-b818-4b26-960f-a8b065f82329 tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003721 May 13 15:04:33.407198 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 454/925] 10.222.0.99 () {58 vars in 1136 bytes} [Fri May 13 15:04:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 13 15:04:33.415185 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4f6b5493-4e34-45a6-8db0-b691ab364f5b tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Calling method '.version_select at 0x7fcf4c9b3700>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:33.442775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-4f6b5493-4e34-45a6-8db0-b691ab364f5b tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] HTTP exception thrown: Volume a075ef22-af6a-4658-b625-8e404fe0c8fa could not be found. May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4f6b5493-4e34-45a6-8db0-b691ab364f5b tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Request method failure captured: May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: DELETE /compute/v2.1/os-volumes/a075ef22-af6a-4658-b625-8e404fe0c8fa HTTP/1.1 May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnOBDBSNW2N1AvY8fuh-bBb-CzOLkHpZB6pe9zPjsao7TQSI3hUI184Q0M_sTSZ1lYirfB9k-f8muopnbnBPkBBlZQT3XRw1nbLE6MuUafKAREBnvns6c3d2GQ-9cl5VIGRsLA7tUby7D64sNYf8bq5hdDw1raPk7hFpESVHJYKCLBc May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 3071efd93e1747bbb2ba7f5bfdb5464a May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:04:33.444762 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:04:33.446221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3071efd93e1747bbb2ba7f5bfdb5464a", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:33.446221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.446221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 3071efd93e1747bbb2ba7f5bfdb5464a May 13 15:04:33.446221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.446221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-VolumesNegativeTest-232099936-project May 13 15:04:33.446221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:04:33.446221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:04:33.446221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 8b9bf8ffc56140849ed6a162de4bca39 May 13 15:04:33.446221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-VolumesNegativeTest-232099936-project May 13 15:04:33.446221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: May 13 15:04:33.446221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Volume a075ef22-af6a-4658-b625-8e404fe0c8fa could not be found. May 13 15:04:33.446221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': 'a075ef22-af6a-4658-b625-8e404fe0c8fa'} May 13 15:04:33.446221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a075ef22-af6a-4658-b625-8e404fe0c8fa could not be found. (HTTP 404) (Request-ID: req-f582e45b-36d2-4a09-804b-488bb061300d) May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:33.447123 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 15:04:33.448488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a075ef22-af6a-4658-b625-8e404fe0c8fa could not be found. May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 15:04:33.449829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:04:33.451199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a075ef22-af6a-4658-b625-8e404fe0c8fa could not be found. May 13 15:04:33.451199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.451199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:33.451199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.451199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.451199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:33.451199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:33.451199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:04:33.451199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:04:33.451199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a075ef22-af6a-4658-b625-8e404fe0c8fa could not be found. May 13 15:04:33.451199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:04:33.451199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4f6b5493-4e34-45a6-8db0-b691ab364f5b tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Returning 404 to user: Volume a075ef22-af6a-4658-b625-8e404fe0c8fa could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:33.451199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4f6b5493-4e34-45a6-8db0-b691ab364f5b tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/a075ef22-af6a-4658-b625-8e404fe0c8fa" status: 404 len: 109 microversion: 2.1 time: 0.034513 May 13 15:04:33.451199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 472/926] 10.222.0.99 () {58 vars in 1247 bytes} [Fri May 13 15:04:33 2022] DELETE /compute/v2.1/os-volumes/a075ef22-af6a-4658-b625-8e404fe0c8fa => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:04:33.455658 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f765206e-adcc-4d19-880f-ec9fc516f8ad tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Calling method '.version_select at 0x7fcf4805e430>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:04:33.483919 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-f765206e-adcc-4d19-880f-ec9fc516f8ad tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] HTTP exception thrown: Volume 60ede75b-89be-4615-9e8a-9502f5b71fe8 could not be found. May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f765206e-adcc-4d19-880f-ec9fc516f8ad tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Request method failure captured: May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: GET /compute/v2.1/os-volumes/60ede75b-89be-4615-9e8a-9502f5b71fe8 HTTP/1.1 May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnOBDBSNW2N1AvY8fuh-bBb-CzOLkHpZB6pe9zPjsao7TQSI3hUI184Q0M_sTSZ1lYirfB9k-f8muopnbnBPkBBlZQT3XRw1nbLE6MuUafKAREBnvns6c3d2GQ-9cl5VIGRsLA7tUby7D64sNYf8bq5hdDw1raPk7hFpESVHJYKCLBc May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 3071efd93e1747bbb2ba7f5bfdb5464a May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:04:33.485855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:04:33.487312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_3071efd93e1747bbb2ba7f5bfdb5464a", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/3071efd93e1747bbb2ba7f5bfdb5464a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:04:33.487312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.487312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 3071efd93e1747bbb2ba7f5bfdb5464a May 13 15:04:33.487312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-VolumesNegativeTest-232099936 May 13 15:04:33.487312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-VolumesNegativeTest-232099936-project May 13 15:04:33.487312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:04:33.487312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:04:33.487312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: 8b9bf8ffc56140849ed6a162de4bca39 May 13 15:04:33.487312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-VolumesNegativeTest-232099936-project May 13 15:04:33.487312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: May 13 15:04:33.487312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Volume 60ede75b-89be-4615-9e8a-9502f5b71fe8 could not be found. May 13 15:04:33.487312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': '60ede75b-89be-4615-9e8a-9502f5b71fe8'} May 13 15:04:33.487312 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 60ede75b-89be-4615-9e8a-9502f5b71fe8 could not be found. (HTTP 404) (Request-ID: req-841ec08b-eb49-472e-be60-d0cb38bc330b) May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:33.488137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 15:04:33.489360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 60ede75b-89be-4615-9e8a-9502f5b71fe8 could not be found. May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 15:04:33.490481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:04:33.491653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 60ede75b-89be-4615-9e8a-9502f5b71fe8 could not be found. May 13 15:04:33.491653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.491653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:04:33.491653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.491653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:04:33.491653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:04:33.491653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:04:33.491653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:04:33.491653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:04:33.491653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 60ede75b-89be-4615-9e8a-9502f5b71fe8 could not be found. May 13 15:04:33.491653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:04:33.491653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f765206e-adcc-4d19-880f-ec9fc516f8ad tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] Returning 404 to user: Volume 60ede75b-89be-4615-9e8a-9502f5b71fe8 could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:04:33.491653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f765206e-adcc-4d19-880f-ec9fc516f8ad tempest-VolumesNegativeTest-232099936 tempest-VolumesNegativeTest-232099936-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/60ede75b-89be-4615-9e8a-9502f5b71fe8" status: 404 len: 109 microversion: 2.1 time: 0.035400 May 13 15:04:33.491653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 455/927] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 15:04:33 2022] GET /compute/v2.1/os-volumes/60ede75b-89be-4615-9e8a-9502f5b71fe8 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:05:01.315920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e3aa4c3a-6a33-4c67-a3a1-b65b1a81c5f9 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1387122711", "imageRef": "eac0bc7b-d963-4624-aba3-a81fd1bf324c", "flavorRef": "452"}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:05:01.372320 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.network.neutron [None req-e3aa4c3a-6a33-4c67-a3a1-b65b1a81c5f9 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] validate_networks() for None {{(pid=117295) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 15:05:01.653670 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-e3aa4c3a-6a33-4c67-a3a1-b65b1a81c5f9 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Flavor limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 15:05:01.654090 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-e3aa4c3a-6a33-4c67-a3a1-b65b1a81c5f9 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Image limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 15:05:01.654553 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-e3aa4c3a-6a33-4c67-a3a1-b65b1a81c5f9 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Flavor pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 15:05:01.654952 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-e3aa4c3a-6a33-4c67-a3a1-b65b1a81c5f9 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Image pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 15:05:01.655355 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-e3aa4c3a-6a33-4c67-a3a1-b65b1a81c5f9 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 15:05:01.665786 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e3aa4c3a-6a33-4c67-a3a1-b65b1a81c5f9 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:01.666169 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e3aa4c3a-6a33-4c67-a3a1-b65b1a81c5f9 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:01.666970 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e3aa4c3a-6a33-4c67-a3a1-b65b1a81c5f9 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:01.667404 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e3aa4c3a-6a33-4c67-a3a1-b65b1a81c5f9 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:01.685165 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-e3aa4c3a-6a33-4c67-a3a1-b65b1a81c5f9 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Getting quotas for project d2bc498dbd674965a795f4ea1e1ba246. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 15:05:01.689701 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-e3aa4c3a-6a33-4c67-a3a1-b65b1a81c5f9 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Getting quotas for user 8a3e1aa1fc2640849e8315f84c98b625 and project d2bc498dbd674965a795f4ea1e1ba246. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 15:05:01.702853 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e3aa4c3a-6a33-4c67-a3a1-b65b1a81c5f9 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Going to run 1 instances... {{(pid=117295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 15:05:01.705264 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e3aa4c3a-6a33-4c67-a3a1-b65b1a81c5f9 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eac0bc7b-d963-4624-aba3-a81fd1bf324c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 15:05:01.751723 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e3aa4c3a-6a33-4c67-a3a1-b65b1a81c5f9 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.440753 May 13 15:05:01.752462 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 473/928] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 15:05:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 15:05:01.764370 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-03a2ee9f-ac90-4606-944e-8f3e1c66d811 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:01.765010 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-03a2ee9f-ac90-4606-944e-8f3e1c66d811 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:01.820015 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-03a2ee9f-ac90-4606-944e-8f3e1c66d811 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3e1aa1fc2640849e8315f84c98b625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc498dbd674965a795f4ea1e1ba246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:01.827692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-03a2ee9f-ac90-4606-944e-8f3e1c66d811 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636" status: 200 len: 1215 microversion: 2.1 time: 0.068808 May 13 15:05:01.828310 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 456/929] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:05:01 2022] GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:05:02.846614 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f46e6909-a002-4876-9ad4-39a99a6589cc tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:02.847204 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f46e6909-a002-4876-9ad4-39a99a6589cc tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:02.853895 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f46e6909-a002-4876-9ad4-39a99a6589cc tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:02.854326 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f46e6909-a002-4876-9ad4-39a99a6589cc tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:02.855404 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f46e6909-a002-4876-9ad4-39a99a6589cc tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:02.855848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f46e6909-a002-4876-9ad4-39a99a6589cc tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:02.927488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f46e6909-a002-4876-9ad4-39a99a6589cc tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3e1aa1fc2640849e8315f84c98b625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc498dbd674965a795f4ea1e1ba246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:02.938294 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f46e6909-a002-4876-9ad4-39a99a6589cc tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636" status: 200 len: 1275 microversion: 2.1 time: 0.096776 May 13 15:05:02.938869 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 474/930] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:05:02 2022] GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:05:03.955042 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-669dfb91-dd4b-43e6-8ae2-88e93f227f68 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:03.960124 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-669dfb91-dd4b-43e6-8ae2-88e93f227f68 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:03.969001 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-669dfb91-dd4b-43e6-8ae2-88e93f227f68 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:03.969454 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-669dfb91-dd4b-43e6-8ae2-88e93f227f68 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:03.970286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-669dfb91-dd4b-43e6-8ae2-88e93f227f68 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:03.970722 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-669dfb91-dd4b-43e6-8ae2-88e93f227f68 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:04.110988 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-669dfb91-dd4b-43e6-8ae2-88e93f227f68 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3e1aa1fc2640849e8315f84c98b625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc498dbd674965a795f4ea1e1ba246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:04.118317 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-669dfb91-dd4b-43e6-8ae2-88e93f227f68 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636" status: 200 len: 1315 microversion: 2.1 time: 0.167491 May 13 15:05:04.118908 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 457/931] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:05:03 2022] GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:05:04.806107 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-0c2aec27-1b39-4b70-b3c4-b635c5cd5d70 req-af229f27-cacd-4eb6-b6d5-45fd5203e819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "324b7f80-bdf0-4412-ae22-15e7864cf636", "tag": "f59c6cd2-b54b-47e6-aac1-d5200bfd3556"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:05:04.815368 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-0c2aec27-1b39-4b70-b3c4-b635c5cd5d70 req-af229f27-cacd-4eb6-b6d5-45fd5203e819 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:04.816098 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-0c2aec27-1b39-4b70-b3c4-b635c5cd5d70 req-af229f27-cacd-4eb6-b6d5-45fd5203e819 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:04.830752 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-0c2aec27-1b39-4b70-b3c4-b635c5cd5d70 req-af229f27-cacd-4eb6-b6d5-45fd5203e819 service nova] Creating event network-changed:f59c6cd2-b54b-47e6-aac1-d5200bfd3556 for instance 324b7f80-bdf0-4412-ae22-15e7864cf636 on hv-cinder-83090 May 13 15:05:04.835942 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-0c2aec27-1b39-4b70-b3c4-b635c5cd5d70 req-af229f27-cacd-4eb6-b6d5-45fd5203e819 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180751 May 13 15:05:04.836559 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 475/932] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 15:05:05.138689 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-26d0376a-94c6-4516-bbcf-860ed7314032 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:05.139919 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-26d0376a-94c6-4516-bbcf-860ed7314032 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:05.146894 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-26d0376a-94c6-4516-bbcf-860ed7314032 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:05.147662 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-26d0376a-94c6-4516-bbcf-860ed7314032 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:05.148737 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-26d0376a-94c6-4516-bbcf-860ed7314032 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:05.149415 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-26d0376a-94c6-4516-bbcf-860ed7314032 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:05.288556 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-26d0376a-94c6-4516-bbcf-860ed7314032 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3e1aa1fc2640849e8315f84c98b625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc498dbd674965a795f4ea1e1ba246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:05.296711 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-26d0376a-94c6-4516-bbcf-860ed7314032 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636" status: 200 len: 1315 microversion: 2.1 time: 0.163634 May 13 15:05:05.297275 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 458/933] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:05:05 2022] GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:05:05.865326 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4f3ffd51-e986-4363-8705-43367cebb375 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:05.866370 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4f3ffd51-e986-4363-8705-43367cebb375 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:05.872695 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4f3ffd51-e986-4363-8705-43367cebb375 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:05.873233 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4f3ffd51-e986-4363-8705-43367cebb375 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:05.874005 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4f3ffd51-e986-4363-8705-43367cebb375 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:05.874443 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4f3ffd51-e986-4363-8705-43367cebb375 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:05.904819 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4f3ffd51-e986-4363-8705-43367cebb375 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044010 May 13 15:05:05.905389 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 476/934] 10.222.0.99 () {60 vars in 1342 bytes} [Fri May 13 15:05:05 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:05:05.963089 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6e0a2990-8d0b-4b08-b06d-f78ec291465c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:05.963582 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6e0a2990-8d0b-4b08-b06d-f78ec291465c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:05.970368 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e0a2990-8d0b-4b08-b06d-f78ec291465c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:05.970843 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e0a2990-8d0b-4b08-b06d-f78ec291465c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:05.971785 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e0a2990-8d0b-4b08-b06d-f78ec291465c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:05.972488 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e0a2990-8d0b-4b08-b06d-f78ec291465c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:05.999671 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6e0a2990-8d0b-4b08-b06d-f78ec291465c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Going to try to terminate instance {{(pid=117296) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 15:05:06.100436 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6e0a2990-8d0b-4b08-b06d-f78ec291465c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "DELETE /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 204 len: 0 microversion: 2.20 time: 0.140941 May 13 15:05:06.101019 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 459/935] 10.222.0.99 () {60 vars in 1279 bytes} [Fri May 13 15:05:05 2022] DELETE /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 15:05:06.109447 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-12fe4eff-57e7-42be-acae-bd54fa226fd2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:06.110058 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-12fe4eff-57e7-42be-acae-bd54fa226fd2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:06.116108 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-12fe4eff-57e7-42be-acae-bd54fa226fd2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:06.116529 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-12fe4eff-57e7-42be-acae-bd54fa226fd2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:06.117316 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-12fe4eff-57e7-42be-acae-bd54fa226fd2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:06.117766 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-12fe4eff-57e7-42be-acae-bd54fa226fd2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:06.267821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-12fe4eff-57e7-42be-acae-bd54fa226fd2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:06.276615 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-12fe4eff-57e7-42be-acae-bd54fa226fd2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:06.278100 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-12fe4eff-57e7-42be-acae-bd54fa226fd2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:06.280004 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-12fe4eff-57e7-42be-acae-bd54fa226fd2 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1724 microversion: 2.20 time: 0.173727 May 13 15:05:06.280566 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 477/936] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:05:06 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 15:05:06.314602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-19bb6c52-eb7c-419b-b29c-fa8ab4c51717 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:06.315276 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-19bb6c52-eb7c-419b-b29c-fa8ab4c51717 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:06.322242 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-19bb6c52-eb7c-419b-b29c-fa8ab4c51717 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:06.322615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-19bb6c52-eb7c-419b-b29c-fa8ab4c51717 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:06.323381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-19bb6c52-eb7c-419b-b29c-fa8ab4c51717 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:06.323803 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-19bb6c52-eb7c-419b-b29c-fa8ab4c51717 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:06.466562 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-19bb6c52-eb7c-419b-b29c-fa8ab4c51717 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3e1aa1fc2640849e8315f84c98b625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc498dbd674965a795f4ea1e1ba246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:06.475193 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-19bb6c52-eb7c-419b-b29c-fa8ab4c51717 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636" status: 200 len: 1315 microversion: 2.1 time: 0.165125 May 13 15:05:06.475731 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 460/937] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:05:06 2022] GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:05:07.305214 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-01a0f31d-4ea7-4619-a117-d96d3ad98a26 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:07.305821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-01a0f31d-4ea7-4619-a117-d96d3ad98a26 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:07.312600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-01a0f31d-4ea7-4619-a117-d96d3ad98a26 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:07.313043 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-01a0f31d-4ea7-4619-a117-d96d3ad98a26 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:07.313983 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-01a0f31d-4ea7-4619-a117-d96d3ad98a26 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:07.314416 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-01a0f31d-4ea7-4619-a117-d96d3ad98a26 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:07.453094 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-01a0f31d-4ea7-4619-a117-d96d3ad98a26 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:07.465679 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-01a0f31d-4ea7-4619-a117-d96d3ad98a26 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:07.468035 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-01a0f31d-4ea7-4619-a117-d96d3ad98a26 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:07.469905 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-01a0f31d-4ea7-4619-a117-d96d3ad98a26 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1724 microversion: 2.20 time: 0.168261 May 13 15:05:07.471090 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 478/938] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:05:07 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:05:07.496898 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-538be4c5-a3f6-4bc5-907e-f89cc37267c1 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:07.497492 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-538be4c5-a3f6-4bc5-907e-f89cc37267c1 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:07.505263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-538be4c5-a3f6-4bc5-907e-f89cc37267c1 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:07.505703 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-538be4c5-a3f6-4bc5-907e-f89cc37267c1 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:07.506468 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-538be4c5-a3f6-4bc5-907e-f89cc37267c1 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:07.506895 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-538be4c5-a3f6-4bc5-907e-f89cc37267c1 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:07.641380 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-538be4c5-a3f6-4bc5-907e-f89cc37267c1 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3e1aa1fc2640849e8315f84c98b625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc498dbd674965a795f4ea1e1ba246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:07.653217 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-538be4c5-a3f6-4bc5-907e-f89cc37267c1 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636" status: 200 len: 1315 microversion: 2.1 time: 0.162161 May 13 15:05:07.653819 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 461/939] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:05:07 2022] GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:05:08.495626 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-c26ef1c9-72d7-4e0e-88a8-c9c7fe5b1c5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:08.496647 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-c26ef1c9-72d7-4e0e-88a8-c9c7fe5b1c5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:08.505307 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c26ef1c9-72d7-4e0e-88a8-c9c7fe5b1c5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:08.505712 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c26ef1c9-72d7-4e0e-88a8-c9c7fe5b1c5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:08.506437 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c26ef1c9-72d7-4e0e-88a8-c9c7fe5b1c5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:08.506870 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-c26ef1c9-72d7-4e0e-88a8-c9c7fe5b1c5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:08.657251 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c26ef1c9-72d7-4e0e-88a8-c9c7fe5b1c5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:08.667764 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c26ef1c9-72d7-4e0e-88a8-c9c7fe5b1c5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:08.669260 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-c26ef1c9-72d7-4e0e-88a8-c9c7fe5b1c5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:08.670409 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-c26ef1c9-72d7-4e0e-88a8-c9c7fe5b1c5c tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1724 microversion: 2.20 time: 0.181407 May 13 15:05:08.670969 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 479/940] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:05:08 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:05:08.672241 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-d3cf001c-d00d-449b-a48c-99019bd1dbc6 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:08.673193 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-d3cf001c-d00d-449b-a48c-99019bd1dbc6 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:08.680475 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d3cf001c-d00d-449b-a48c-99019bd1dbc6 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:08.680924 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d3cf001c-d00d-449b-a48c-99019bd1dbc6 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:08.681698 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d3cf001c-d00d-449b-a48c-99019bd1dbc6 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:08.682135 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d3cf001c-d00d-449b-a48c-99019bd1dbc6 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:08.817232 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-d3cf001c-d00d-449b-a48c-99019bd1dbc6 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3e1aa1fc2640849e8315f84c98b625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc498dbd674965a795f4ea1e1ba246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:08.825141 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-d3cf001c-d00d-449b-a48c-99019bd1dbc6 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636" status: 200 len: 1315 microversion: 2.1 time: 0.156921 May 13 15:05:08.825709 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 462/941] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:05:08 2022] GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 15:05:09.690231 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-2cd02b79-fc7f-4218-9d3e-0abea755c7e9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:09.690804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-2cd02b79-fc7f-4218-9d3e-0abea755c7e9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:09.697697 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2cd02b79-fc7f-4218-9d3e-0abea755c7e9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:09.698143 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2cd02b79-fc7f-4218-9d3e-0abea755c7e9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:09.698909 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2cd02b79-fc7f-4218-9d3e-0abea755c7e9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:09.699338 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2cd02b79-fc7f-4218-9d3e-0abea755c7e9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:09.839747 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-2cd02b79-fc7f-4218-9d3e-0abea755c7e9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:09.841862 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-714a245b-a03c-4be2-a539-425dae44752e tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:09.843060 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-714a245b-a03c-4be2-a539-425dae44752e tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:09.849216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-2cd02b79-fc7f-4218-9d3e-0abea755c7e9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:09.850484 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-714a245b-a03c-4be2-a539-425dae44752e tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:09.850667 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-2cd02b79-fc7f-4218-9d3e-0abea755c7e9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:09.850936 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-714a245b-a03c-4be2-a539-425dae44752e tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:09.851815 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-714a245b-a03c-4be2-a539-425dae44752e tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:09.851991 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-2cd02b79-fc7f-4218-9d3e-0abea755c7e9 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1724 microversion: 2.20 time: 0.166425 May 13 15:05:09.852280 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-714a245b-a03c-4be2-a539-425dae44752e tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:09.852418 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 480/942] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:05:09 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:05:09.989305 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-714a245b-a03c-4be2-a539-425dae44752e tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3e1aa1fc2640849e8315f84c98b625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc498dbd674965a795f4ea1e1ba246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:09.996858 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-714a245b-a03c-4be2-a539-425dae44752e tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636" status: 200 len: 1315 microversion: 2.1 time: 0.159301 May 13 15:05:09.997451 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 463/943] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:05:09 2022] GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:05:10.871111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ad20ce7c-f9ff-4a0d-8e27-4fb27df0ddd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:10.873200 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ad20ce7c-f9ff-4a0d-8e27-4fb27df0ddd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:10.880349 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ad20ce7c-f9ff-4a0d-8e27-4fb27df0ddd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:10.881346 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ad20ce7c-f9ff-4a0d-8e27-4fb27df0ddd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:10.883148 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ad20ce7c-f9ff-4a0d-8e27-4fb27df0ddd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:10.884143 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ad20ce7c-f9ff-4a0d-8e27-4fb27df0ddd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:10.950089 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ad20ce7c-f9ff-4a0d-8e27-4fb27df0ddd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:10.964359 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ad20ce7c-f9ff-4a0d-8e27-4fb27df0ddd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:10.967480 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ad20ce7c-f9ff-4a0d-8e27-4fb27df0ddd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:10.970087 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ad20ce7c-f9ff-4a0d-8e27-4fb27df0ddd5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1656 microversion: 2.20 time: 0.103235 May 13 15:05:10.971588 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 481/944] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:05:10 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1656 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:05:10.983528 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-b63dcc71-a8bd-488e-967f-5c5525719106 req-0f914b96-f0af-437a-ad21-558d0f2e4df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324b7f80-bdf0-4412-ae22-15e7864cf636", "name": "network-vif-plugged", "status": "completed", "tag": "f59c6cd2-b54b-47e6-aac1-d5200bfd3556"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:05:10.994685 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-b63dcc71-a8bd-488e-967f-5c5525719106 req-0f914b96-f0af-437a-ad21-558d0f2e4df7 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:10.995162 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-b63dcc71-a8bd-488e-967f-5c5525719106 req-0f914b96-f0af-437a-ad21-558d0f2e4df7 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:11.006855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-b63dcc71-a8bd-488e-967f-5c5525719106 req-0f914b96-f0af-437a-ad21-558d0f2e4df7 service nova] Creating event network-vif-plugged:f59c6cd2-b54b-47e6-aac1-d5200bfd3556 for instance 324b7f80-bdf0-4412-ae22-15e7864cf636 on hv-cinder-83090 May 13 15:05:11.012406 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-b63dcc71-a8bd-488e-967f-5c5525719106 req-0f914b96-f0af-437a-ad21-558d0f2e4df7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034072 May 13 15:05:11.013656 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 464/945] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:05:11.014097 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-5dd0ceff-d831-4c49-92eb-aeb139538802 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:11.014897 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-5dd0ceff-d831-4c49-92eb-aeb139538802 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:11.022365 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5dd0ceff-d831-4c49-92eb-aeb139538802 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:11.023072 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5dd0ceff-d831-4c49-92eb-aeb139538802 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:11.024710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5dd0ceff-d831-4c49-92eb-aeb139538802 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:11.025227 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5dd0ceff-d831-4c49-92eb-aeb139538802 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:11.175233 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-5dd0ceff-d831-4c49-92eb-aeb139538802 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3e1aa1fc2640849e8315f84c98b625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc498dbd674965a795f4ea1e1ba246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:11.183035 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-5dd0ceff-d831-4c49-92eb-aeb139538802 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636" status: 200 len: 1315 microversion: 2.1 time: 0.173267 May 13 15:05:11.183621 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 482/946] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:05:11 2022] GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:05:11.218675 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-7486cd09-5828-42f3-8ab2-6d2ceeccc61e req-b5ba84a7-4d0d-4ed5-b25c-2f3edd093c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d326e41-aedb-47b1-bf2f-e7784d3d4894", "name": "network-vif-deleted", "tag": "31bf981e-aa80-4a0b-a642-84d2bded56aa"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:05:11.227918 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-7486cd09-5828-42f3-8ab2-6d2ceeccc61e req-b5ba84a7-4d0d-4ed5-b25c-2f3edd093c39 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:11.233582 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-7486cd09-5828-42f3-8ab2-6d2ceeccc61e req-b5ba84a7-4d0d-4ed5-b25c-2f3edd093c39 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:11.248879 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-7486cd09-5828-42f3-8ab2-6d2ceeccc61e req-b5ba84a7-4d0d-4ed5-b25c-2f3edd093c39 service nova] Creating event network-vif-deleted:31bf981e-aa80-4a0b-a642-84d2bded56aa for instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 on hv-cinder-83090 May 13 15:05:11.254284 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-7486cd09-5828-42f3-8ab2-6d2ceeccc61e req-b5ba84a7-4d0d-4ed5-b25c-2f3edd093c39 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039863 May 13 15:05:11.255140 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 465/947] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:05:11.993416 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4171dee2-fb72-4e39-a10c-b11177da9184 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:11.994031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4171dee2-fb72-4e39-a10c-b11177da9184 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:12.002886 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4171dee2-fb72-4e39-a10c-b11177da9184 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:12.003341 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4171dee2-fb72-4e39-a10c-b11177da9184 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:12.004157 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4171dee2-fb72-4e39-a10c-b11177da9184 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:12.004596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4171dee2-fb72-4e39-a10c-b11177da9184 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:12.039017 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4171dee2-fb72-4e39-a10c-b11177da9184 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:12.039481 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4171dee2-fb72-4e39-a10c-b11177da9184 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:12.039960 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-4171dee2-fb72-4e39-a10c-b11177da9184 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lazy-loading 'fault' on Instance uuid 7d326e41-aedb-47b1-bf2f-e7784d3d4894 {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:05:12.082838 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4171dee2-fb72-4e39-a10c-b11177da9184 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:12.091423 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4171dee2-fb72-4e39-a10c-b11177da9184 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:12.092936 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4171dee2-fb72-4e39-a10c-b11177da9184 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ac89928ac188406d910838be33a61c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d31191dfc694e3b94a6139dd2e9653f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:12.094106 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4171dee2-fb72-4e39-a10c-b11177da9184 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 200 len: 1371 microversion: 2.20 time: 0.105565 May 13 15:05:12.095008 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 483/948] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:05:11 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 15:05:12.201195 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-dc6e46d4-27b6-491d-b698-f21ac2858b6f tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:12.201996 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-dc6e46d4-27b6-491d-b698-f21ac2858b6f tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:12.208791 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dc6e46d4-27b6-491d-b698-f21ac2858b6f tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:12.209291 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dc6e46d4-27b6-491d-b698-f21ac2858b6f tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:12.210159 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dc6e46d4-27b6-491d-b698-f21ac2858b6f tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:12.210652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-dc6e46d4-27b6-491d-b698-f21ac2858b6f tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:12.346885 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-dc6e46d4-27b6-491d-b698-f21ac2858b6f tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3e1aa1fc2640849e8315f84c98b625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc498dbd674965a795f4ea1e1ba246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:12.355037 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-dc6e46d4-27b6-491d-b698-f21ac2858b6f tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636" status: 200 len: 1315 microversion: 2.1 time: 0.158333 May 13 15:05:12.355610 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 466/949] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:05:12 2022] GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:05:13.115173 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-80542942-67f8-44a3-afc5-fbc110afb8e7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:13.115734 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-80542942-67f8-44a3-afc5-fbc110afb8e7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:13.122721 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-80542942-67f8-44a3-afc5-fbc110afb8e7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:13.123161 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-80542942-67f8-44a3-afc5-fbc110afb8e7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:13.124009 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-80542942-67f8-44a3-afc5-fbc110afb8e7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:13.124422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-80542942-67f8-44a3-afc5-fbc110afb8e7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:13.140586 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-80542942-67f8-44a3-afc5-fbc110afb8e7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] HTTP exception thrown: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-80542942-67f8-44a3-afc5-fbc110afb8e7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Request method failure captured: May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 HTTP/1.1 May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnEQgrlA5i3R7SWL6crQlDizwHkqb-2xI3k7Lm_nlzjadbOU3BuFdsGTw2elv2hA2YFDWCs1lC0SC6X-QGRQictZidoiM7h6N_gG5jMk3ZLXUbcBTsRYon4xnYTaQvI72l612hToEehW4wF0oZwcsCC7fXFuLQ9FBQ2ZdW9HPs2vG4M May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Openstack-Nova-Api-Version: 2.20 May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 9d31191dfc694e3b94a6139dd2e9653f May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:05:13.142417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:05:13.144240 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9d31191dfc694e3b94a6139dd2e9653f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:05:13.144240 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:05:13.144240 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 9d31191dfc694e3b94a6139dd2e9653f May 13 15:05:13.144240 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:05:13.144240 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-AttachVolumeShelveTestJSON-1242529642-project May 13 15:05:13.144240 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:05:13.144240 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:05:13.144240 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: ac89928ac188406d910838be33a61c3e May 13 15:05:13.144240 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1242529642-project May 13 15:05:13.144240 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:05:13.144240 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. May 13 15:05:13.144240 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '7d326e41-aedb-47b1-bf2f-e7784d3d4894'} May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:05:13.145172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. May 13 15:05:13.146728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:13.148147 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-80542942-67f8-44a3-afc5-fbc110afb8e7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Returning 404 to user: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:05:13.148147 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-80542942-67f8-44a3-afc5-fbc110afb8e7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 404 len: 111 microversion: 2.20 time: 0.032654 May 13 15:05:13.148147 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 484/950] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:05:13 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 15:05:13.153467 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6c8b4e6c-4efb-4984-8df2-a9bc7cc229c5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '.version_select at 0x7fcf4cbaf8b0>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:13.174917 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6c8b4e6c-4efb-4984-8df2-a9bc7cc229c5 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-845874534" status: 204 len: 0 microversion: 2.20 time: 0.025296 May 13 15:05:13.175492 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 467/951] 10.222.0.99 () {60 vars in 1258 bytes} [Fri May 13 15:05:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-845874534 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 15:05:13.372596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ac51786d-a6ec-4929-b4a6-d43dcae85f12 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:13.373117 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ac51786d-a6ec-4929-b4a6-d43dcae85f12 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:13.379530 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ac51786d-a6ec-4929-b4a6-d43dcae85f12 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:13.380003 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ac51786d-a6ec-4929-b4a6-d43dcae85f12 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:13.380782 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ac51786d-a6ec-4929-b4a6-d43dcae85f12 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:13.381200 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ac51786d-a6ec-4929-b4a6-d43dcae85f12 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:13.532219 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ac51786d-a6ec-4929-b4a6-d43dcae85f12 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3e1aa1fc2640849e8315f84c98b625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc498dbd674965a795f4ea1e1ba246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:13.539540 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ac51786d-a6ec-4929-b4a6-d43dcae85f12 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636" status: 200 len: 1315 microversion: 2.1 time: 0.170912 May 13 15:05:13.540143 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 485/952] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:05:13 2022] GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:05:14.560671 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-22c6ce28-c3f4-4340-b24a-f6716e0a9218 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:14.561672 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-22c6ce28-c3f4-4340-b24a-f6716e0a9218 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:14.572845 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-22c6ce28-c3f4-4340-b24a-f6716e0a9218 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:14.573620 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-22c6ce28-c3f4-4340-b24a-f6716e0a9218 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:14.574900 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-22c6ce28-c3f4-4340-b24a-f6716e0a9218 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:14.575636 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-22c6ce28-c3f4-4340-b24a-f6716e0a9218 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:14.720250 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-22c6ce28-c3f4-4340-b24a-f6716e0a9218 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3e1aa1fc2640849e8315f84c98b625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc498dbd674965a795f4ea1e1ba246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:14.728786 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-22c6ce28-c3f4-4340-b24a-f6716e0a9218 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636" status: 200 len: 1465 microversion: 2.1 time: 0.174546 May 13 15:05:14.729282 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 468/953] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:05:14 2022] GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 => generated 1465 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:05:14.767119 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9b4b5da1-c002-4509-a340-8584dd748011 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:14.767621 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9b4b5da1-c002-4509-a340-8584dd748011 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:14.774630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9b4b5da1-c002-4509-a340-8584dd748011 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:14.775081 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9b4b5da1-c002-4509-a340-8584dd748011 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:14.775862 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9b4b5da1-c002-4509-a340-8584dd748011 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:14.776316 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9b4b5da1-c002-4509-a340-8584dd748011 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:14.801384 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9b4b5da1-c002-4509-a340-8584dd748011 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Going to try to terminate instance {{(pid=117295) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 15:05:14.883114 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9b4b5da1-c002-4509-a340-8584dd748011 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "DELETE /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636" status: 204 len: 0 microversion: 2.1 time: 0.119690 May 13 15:05:14.884167 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 486/954] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:05:14 2022] DELETE /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 15:05:14.892273 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-4e453297-f3c0-416c-bd83-6edef6dd29a0 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:14.892880 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-4e453297-f3c0-416c-bd83-6edef6dd29a0 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:14.901141 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4e453297-f3c0-416c-bd83-6edef6dd29a0 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:14.901772 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4e453297-f3c0-416c-bd83-6edef6dd29a0 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:14.902631 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4e453297-f3c0-416c-bd83-6edef6dd29a0 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:14.903252 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4e453297-f3c0-416c-bd83-6edef6dd29a0 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:14.964063 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-1ac77d66-c722-4c9c-909f-27cb58eda123 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:14.964644 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-1ac77d66-c722-4c9c-909f-27cb58eda123 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:14.970733 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1ac77d66-c722-4c9c-909f-27cb58eda123 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:14.971180 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1ac77d66-c722-4c9c-909f-27cb58eda123 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:14.971984 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1ac77d66-c722-4c9c-909f-27cb58eda123 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:14.972424 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1ac77d66-c722-4c9c-909f-27cb58eda123 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:14.986847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-1ac77d66-c722-4c9c-909f-27cb58eda123 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] HTTP exception thrown: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-1ac77d66-c722-4c9c-909f-27cb58eda123 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Request method failure captured: May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: DELETE /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 HTTP/1.1 May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnEQgrlA5i3R7SWL6crQlDizwHkqb-2xI3k7Lm_nlzjadbOU3BuFdsGTw2elv2hA2YFDWCs1lC0SC6X-QGRQictZidoiM7h6N_gG5jMk3ZLXUbcBTsRYon4xnYTaQvI72l612hToEehW4wF0oZwcsCC7fXFuLQ9FBQ2ZdW9HPs2vG4M May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Openstack-Nova-Api-Version: 2.20 May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 9d31191dfc694e3b94a6139dd2e9653f May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:05:14.988556 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:05:14.990259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9d31191dfc694e3b94a6139dd2e9653f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:05:14.990259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:05:14.990259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 9d31191dfc694e3b94a6139dd2e9653f May 13 15:05:14.990259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:05:14.990259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-AttachVolumeShelveTestJSON-1242529642-project May 13 15:05:14.990259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:05:14.990259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:05:14.990259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: ac89928ac188406d910838be33a61c3e May 13 15:05:14.990259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1242529642-project May 13 15:05:14.990259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:05:14.990259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. May 13 15:05:14.990259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '7d326e41-aedb-47b1-bf2f-e7784d3d4894'} May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:05:14.991126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. May 13 15:05:14.992844 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:14.994376 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-1ac77d66-c722-4c9c-909f-27cb58eda123 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Returning 404 to user: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:05:14.994376 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-1ac77d66-c722-4c9c-909f-27cb58eda123 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "DELETE /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 404 len: 111 microversion: 2.20 time: 0.030215 May 13 15:05:14.994376 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 487/955] 10.222.0.99 () {60 vars in 1279 bytes} [Fri May 13 15:05:14 2022] DELETE /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 13 15:05:14.998238 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e26cdb88-a2cb-48e0-bbd2-14d311e12fa7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:14.998870 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e26cdb88-a2cb-48e0-bbd2-14d311e12fa7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 7d326e41-aedb-47b1-bf2f-e7784d3d4894] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:15.005054 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e26cdb88-a2cb-48e0-bbd2-14d311e12fa7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:15.005526 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e26cdb88-a2cb-48e0-bbd2-14d311e12fa7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:15.006292 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e26cdb88-a2cb-48e0-bbd2-14d311e12fa7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:15.006720 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e26cdb88-a2cb-48e0-bbd2-14d311e12fa7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:15.020967 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-e26cdb88-a2cb-48e0-bbd2-14d311e12fa7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] HTTP exception thrown: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e26cdb88-a2cb-48e0-bbd2-14d311e12fa7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Request method failure captured: May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 HTTP/1.1 May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnEQgrlA5i3R7SWL6crQlDizwHkqb-2xI3k7Lm_nlzjadbOU3BuFdsGTw2elv2hA2YFDWCs1lC0SC6X-QGRQictZidoiM7h6N_gG5jMk3ZLXUbcBTsRYon4xnYTaQvI72l612hToEehW4wF0oZwcsCC7fXFuLQ9FBQ2ZdW9HPs2vG4M May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Openstack-Nova-Api-Version: 2.20 May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 9d31191dfc694e3b94a6139dd2e9653f May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:05:15.022510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:05:15.024335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9d31191dfc694e3b94a6139dd2e9653f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:05:15.024335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:05:15.024335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 9d31191dfc694e3b94a6139dd2e9653f May 13 15:05:15.024335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:05:15.024335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-AttachVolumeShelveTestJSON-1242529642-project May 13 15:05:15.024335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:05:15.024335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:05:15.024335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: ac89928ac188406d910838be33a61c3e May 13 15:05:15.024335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1242529642-project May 13 15:05:15.024335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:05:15.024335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. May 13 15:05:15.024335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '7d326e41-aedb-47b1-bf2f-e7784d3d4894'} May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:05:15.025130 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. May 13 15:05:15.026730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:15.028025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e26cdb88-a2cb-48e0-bbd2-14d311e12fa7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Returning 404 to user: Instance 7d326e41-aedb-47b1-bf2f-e7784d3d4894 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:05:15.028025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e26cdb88-a2cb-48e0-bbd2-14d311e12fa7 tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894" status: 404 len: 111 microversion: 2.20 time: 0.029245 May 13 15:05:15.028025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 488/956] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:05:14 2022] GET /compute/v2.1/servers/7d326e41-aedb-47b1-bf2f-e7784d3d4894 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 15:05:15.042680 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-4e453297-f3c0-416c-bd83-6edef6dd29a0 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3e1aa1fc2640849e8315f84c98b625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc498dbd674965a795f4ea1e1ba246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:15.050485 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-4e453297-f3c0-416c-bd83-6edef6dd29a0 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636" status: 200 len: 1471 microversion: 2.1 time: 0.162218 May 13 15:05:15.050952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 469/957] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:05:14 2022] GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:05:16.071520 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-643964cf-8372-4500-b42a-be79fd64f381 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:16.072682 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-643964cf-8372-4500-b42a-be79fd64f381 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:16.082136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-643964cf-8372-4500-b42a-be79fd64f381 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:16.082585 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-643964cf-8372-4500-b42a-be79fd64f381 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:16.083366 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-643964cf-8372-4500-b42a-be79fd64f381 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:16.083802 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-643964cf-8372-4500-b42a-be79fd64f381 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:16.160159 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7b898d75-650f-4398-ab4b-93cc710929be tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:16.160713 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7b898d75-650f-4398-ab4b-93cc710929be tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:16.167142 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7b898d75-650f-4398-ab4b-93cc710929be tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:16.167587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7b898d75-650f-4398-ab4b-93cc710929be tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:16.168349 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7b898d75-650f-4398-ab4b-93cc710929be tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:16.168802 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7b898d75-650f-4398-ab4b-93cc710929be tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:16.183088 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-7b898d75-650f-4398-ab4b-93cc710929be tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] HTTP exception thrown: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7b898d75-650f-4398-ab4b-93cc710929be tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Request method failure captured: May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: DELETE /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b HTTP/1.1 May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnEQgrlA5i3R7SWL6crQlDizwHkqb-2xI3k7Lm_nlzjadbOU3BuFdsGTw2elv2hA2YFDWCs1lC0SC6X-QGRQictZidoiM7h6N_gG5jMk3ZLXUbcBTsRYon4xnYTaQvI72l612hToEehW4wF0oZwcsCC7fXFuLQ9FBQ2ZdW9HPs2vG4M May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Openstack-Nova-Api-Version: 2.20 May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 9d31191dfc694e3b94a6139dd2e9653f May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:05:16.184816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:05:16.186512 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9d31191dfc694e3b94a6139dd2e9653f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:05:16.186512 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:05:16.186512 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 9d31191dfc694e3b94a6139dd2e9653f May 13 15:05:16.186512 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:05:16.186512 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-AttachVolumeShelveTestJSON-1242529642-project May 13 15:05:16.186512 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:05:16.186512 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:05:16.186512 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: ac89928ac188406d910838be33a61c3e May 13 15:05:16.186512 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1242529642-project May 13 15:05:16.186512 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 15:05:16.186512 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. May 13 15:05:16.186512 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': '96db69fe-6594-486c-96b3-545e6dbfa29b'} May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:05:16.190525 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. May 13 15:05:16.191927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:05:16.193347 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7b898d75-650f-4398-ab4b-93cc710929be tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Returning 404 to user: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:05:16.193347 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7b898d75-650f-4398-ab4b-93cc710929be tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "DELETE /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 404 len: 111 microversion: 2.20 time: 0.030178 May 13 15:05:16.193347 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 470/958] 10.222.0.99 () {60 vars in 1279 bytes} [Fri May 13 15:05:16 2022] DELETE /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 13 15:05:16.197389 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-78796c45-ea23-4eb2-b7ef-59d72095db7d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:16.198323 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-78796c45-ea23-4eb2-b7ef-59d72095db7d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] [instance: 96db69fe-6594-486c-96b3-545e6dbfa29b] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:16.207269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-78796c45-ea23-4eb2-b7ef-59d72095db7d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:16.207935 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-78796c45-ea23-4eb2-b7ef-59d72095db7d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:16.209141 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-78796c45-ea23-4eb2-b7ef-59d72095db7d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:16.209791 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-78796c45-ea23-4eb2-b7ef-59d72095db7d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:16.223580 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-643964cf-8372-4500-b42a-be79fd64f381 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3e1aa1fc2640849e8315f84c98b625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc498dbd674965a795f4ea1e1ba246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:16.229958 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-78796c45-ea23-4eb2-b7ef-59d72095db7d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] HTTP exception thrown: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. May 13 15:05:16.232320 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-643964cf-8372-4500-b42a-be79fd64f381 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636" status: 200 len: 1471 microversion: 2.1 time: 0.167208 May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-78796c45-ea23-4eb2-b7ef-59d72095db7d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Request method failure captured: May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b HTTP/1.1 May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnEQgrlA5i3R7SWL6crQlDizwHkqb-2xI3k7Lm_nlzjadbOU3BuFdsGTw2elv2hA2YFDWCs1lC0SC6X-QGRQictZidoiM7h6N_gG5jMk3ZLXUbcBTsRYon4xnYTaQvI72l612hToEehW4wF0oZwcsCC7fXFuLQ9FBQ2ZdW9HPs2vG4M May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Openstack-Nova-Api-Version: 2.20 May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 9d31191dfc694e3b94a6139dd2e9653f May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:05:16.232489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:05:16.234057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9d31191dfc694e3b94a6139dd2e9653f", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9d31191dfc694e3b94a6139dd2e9653f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:05:16.234057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:05:16.234057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 9d31191dfc694e3b94a6139dd2e9653f May 13 15:05:16.234057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1242529642 May 13 15:05:16.234057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-AttachVolumeShelveTestJSON-1242529642-project May 13 15:05:16.234057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:05:16.234057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:05:16.234057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: ac89928ac188406d910838be33a61c3e May 13 15:05:16.234057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1242529642-project May 13 15:05:16.234057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 15:05:16.234057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. May 13 15:05:16.234057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': '96db69fe-6594-486c-96b3-545e6dbfa29b'} May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:05:16.234854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. May 13 15:05:16.236286 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:05:16.237566 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 489/959] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:05:16 2022] GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:05:16.237665 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-78796c45-ea23-4eb2-b7ef-59d72095db7d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] Returning 404 to user: Instance 96db69fe-6594-486c-96b3-545e6dbfa29b could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:05:16.237665 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-78796c45-ea23-4eb2-b7ef-59d72095db7d tempest-AttachVolumeShelveTestJSON-1242529642 tempest-AttachVolumeShelveTestJSON-1242529642-project] 10.222.0.99 "GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b" status: 404 len: 111 microversion: 2.20 time: 0.043050 May 13 15:05:16.237665 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 471/960] 10.222.0.99 () {60 vars in 1276 bytes} [Fri May 13 15:05:16 2022] GET /compute/v2.1/servers/96db69fe-6594-486c-96b3-545e6dbfa29b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 13 15:05:17.249904 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3aee92a3-d16a-4ba3-8607-f784ec64a373 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:17.250446 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3aee92a3-d16a-4ba3-8607-f784ec64a373 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:17.257618 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3aee92a3-d16a-4ba3-8607-f784ec64a373 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:17.258074 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3aee92a3-d16a-4ba3-8607-f784ec64a373 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:17.258924 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3aee92a3-d16a-4ba3-8607-f784ec64a373 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:17.259361 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3aee92a3-d16a-4ba3-8607-f784ec64a373 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:17.392957 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3aee92a3-d16a-4ba3-8607-f784ec64a373 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3e1aa1fc2640849e8315f84c98b625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bc498dbd674965a795f4ea1e1ba246', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:05:17.401097 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3aee92a3-d16a-4ba3-8607-f784ec64a373 tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636" status: 200 len: 1471 microversion: 2.1 time: 0.155121 May 13 15:05:17.401826 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 490/961] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:05:17 2022] GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:05:17.706281 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-e51d9cab-5d78-4e68-a6e9-f1ec2d11c12c req-a2f9cf84-b817-4a0f-b4f1-fe422fffde87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "324b7f80-bdf0-4412-ae22-15e7864cf636", "name": "network-vif-deleted", "tag": "f59c6cd2-b54b-47e6-aac1-d5200bfd3556"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:05:17.717461 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-e51d9cab-5d78-4e68-a6e9-f1ec2d11c12c req-a2f9cf84-b817-4a0f-b4f1-fe422fffde87 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:17.718002 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-e51d9cab-5d78-4e68-a6e9-f1ec2d11c12c req-a2f9cf84-b817-4a0f-b4f1-fe422fffde87 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:17.733370 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-e51d9cab-5d78-4e68-a6e9-f1ec2d11c12c req-a2f9cf84-b817-4a0f-b4f1-fe422fffde87 service nova] Creating event network-vif-deleted:f59c6cd2-b54b-47e6-aac1-d5200bfd3556 for instance 324b7f80-bdf0-4412-ae22-15e7864cf636 on hv-cinder-83090 May 13 15:05:17.741244 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-e51d9cab-5d78-4e68-a6e9-f1ec2d11c12c req-a2f9cf84-b817-4a0f-b4f1-fe422fffde87 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040957 May 13 15:05:17.742304 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 472/962] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:05:18.418778 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e31d289b-7e60-48ee-8176-5ed04e7b3b4a tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:18.419329 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e31d289b-7e60-48ee-8176-5ed04e7b3b4a tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] [instance: 324b7f80-bdf0-4412-ae22-15e7864cf636] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:05:18.426893 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e31d289b-7e60-48ee-8176-5ed04e7b3b4a tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:18.427319 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e31d289b-7e60-48ee-8176-5ed04e7b3b4a tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:18.428164 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e31d289b-7e60-48ee-8176-5ed04e7b3b4a tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:05:18.428603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e31d289b-7e60-48ee-8176-5ed04e7b3b4a tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:05:18.442767 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-e31d289b-7e60-48ee-8176-5ed04e7b3b4a tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] HTTP exception thrown: Instance 324b7f80-bdf0-4412-ae22-15e7864cf636 could not be found. May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e31d289b-7e60-48ee-8176-5ed04e7b3b4a tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Request method failure captured: May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 HTTP/1.1 May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnObhptiqB5HRiYgZI2Hlh5aCdKGNiHLJ9kfB-ilebi9WtqB0GEAWxEK9lR3JQnu-A7MGsSXrF832XkcqLoxWj5EO6KBM-cjAINNK4PJ82kFJB9s-13iBuMIpiyb-zj-hTIvUVemmhDVWzmpshysmwyZpx7d1tr3nWtTUqq-mAHdQN4 May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: d2bc498dbd674965a795f4ea1e1ba246 May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-VolumesNegativeTest-2039428142 May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:05:18.444350 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:05:18.445973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_d2bc498dbd674965a795f4ea1e1ba246", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d2bc498dbd674965a795f4ea1e1ba246"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/d2bc498dbd674965a795f4ea1e1ba246"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/d2bc498dbd674965a795f4ea1e1ba246"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:05:18.445973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-VolumesNegativeTest-2039428142 May 13 15:05:18.445973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: d2bc498dbd674965a795f4ea1e1ba246 May 13 15:05:18.445973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-VolumesNegativeTest-2039428142 May 13 15:05:18.445973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-VolumesNegativeTest-2039428142-project May 13 15:05:18.445973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:05:18.445973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:05:18.445973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 8a3e1aa1fc2640849e8315f84c98b625 May 13 15:05:18.445973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-VolumesNegativeTest-2039428142-project May 13 15:05:18.445973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:05:18.445973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 324b7f80-bdf0-4412-ae22-15e7864cf636 could not be found. May 13 15:05:18.445973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '324b7f80-bdf0-4412-ae22-15e7864cf636'} May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 324b7f80-bdf0-4412-ae22-15e7864cf636 could not be found. May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:05:18.447189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 324b7f80-bdf0-4412-ae22-15e7864cf636 could not be found. May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 324b7f80-bdf0-4412-ae22-15e7864cf636 could not be found. May 13 15:05:18.448550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:05:18.449676 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e31d289b-7e60-48ee-8176-5ed04e7b3b4a tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] Returning 404 to user: Instance 324b7f80-bdf0-4412-ae22-15e7864cf636 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:05:18.449676 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e31d289b-7e60-48ee-8176-5ed04e7b3b4a tempest-VolumesNegativeTest-2039428142 tempest-VolumesNegativeTest-2039428142-project] 10.222.0.99 "GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636" status: 404 len: 111 microversion: 2.1 time: 0.030964 May 13 15:05:18.451816 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 491/963] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:05:18 2022] GET /compute/v2.1/servers/324b7f80-bdf0-4412-ae22-15e7864cf636 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:05:22.022528 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-d0ea4411-efb2-43cf-8065-db891610f620 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] Action: 'create', calling method: .version_select at 0x7fcf4cb92790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1308583890", "metadata": {"Type": "work"}}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:05:22.375174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-d0ea4411-efb2-43cf-8065-db891610f620 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.485124 May 13 15:05:22.376060 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 473/964] 10.222.0.99 () {60 vars in 1155 bytes} [Fri May 13 15:05:21 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 488 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 13 15:05:22.387367 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-669a442d-e545-4034-83f4-a893e9a9356f tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] Calling method '.version_select at 0x7fcf4ca5f550>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:22.457800 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-669a442d-e545-4034-83f4-a893e9a9356f tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6" status: 200 len: 353 microversion: 2.1 time: 0.074313 May 13 15:05:22.458428 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 492/965] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 15:05:22 2022] GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6 => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 15:05:23.472773 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-927567b7-d69c-44b7-b93b-5d2e02390d32 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] Calling method '.version_select at 0x7fcf480509d0>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:23.521363 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-927567b7-d69c-44b7-b93b-5d2e02390d32 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6" status: 200 len: 353 microversion: 2.1 time: 0.054265 May 13 15:05:23.521929 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 474/966] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 15:05:23 2022] GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:05:24.534760 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-a5184a4c-98d8-4a65-99dc-1ed3684d8079 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] Calling method '.version_select at 0x7fcf4c9bfc10>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:24.586938 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-a5184a4c-98d8-4a65-99dc-1ed3684d8079 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6" status: 200 len: 353 microversion: 2.1 time: 0.056432 May 13 15:05:24.587496 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 493/967] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 15:05:24 2022] GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:05:25.599717 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e8b6c81c-8df1-4a8f-94cc-c304480bdcc2 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] Calling method '.version_select at 0x7fcf4cbaff70>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:25.653680 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e8b6c81c-8df1-4a8f-94cc-c304480bdcc2 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6" status: 200 len: 353 microversion: 2.1 time: 0.058750 May 13 15:05:25.654225 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 475/968] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 15:05:25 2022] GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:05:26.666992 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4b734510-8817-4709-bd5b-776b8f319526 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] Calling method '.version_select at 0x7fcf4c9bfca0>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:26.712496 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4b734510-8817-4709-bd5b-776b8f319526 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6" status: 200 len: 353 microversion: 2.1 time: 0.049767 May 13 15:05:26.713063 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 494/969] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 15:05:26 2022] GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:05:27.726062 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-0b854b16-53d3-4c86-89a0-8a5a91a2a035 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] Calling method '.version_select at 0x7fcf48050940>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:27.775487 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-0b854b16-53d3-4c86-89a0-8a5a91a2a035 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6" status: 200 len: 353 microversion: 2.1 time: 0.054046 May 13 15:05:27.776103 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 476/970] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 15:05:27 2022] GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:05:28.791300 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-85f8382f-77bf-416f-8fcc-713d0f0e4351 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] Calling method '.version_select at 0x7fcf4c9f4790>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:28.844211 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-85f8382f-77bf-416f-8fcc-713d0f0e4351 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6" status: 200 len: 354 microversion: 2.1 time: 0.057198 May 13 15:05:28.845042 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 495/971] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 15:05:28 2022] GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:05:28.857072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1e5173aa-dd28-40f2-971a-3c0a0e6be838 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] Calling method '.version_select at 0x7fcf480ede50>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:28.905249 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1e5173aa-dd28-40f2-971a-3c0a0e6be838 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6" status: 200 len: 354 microversion: 2.1 time: 0.052456 May 13 15:05:28.905810 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 477/972] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 15:05:28 2022] GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:05:28.924170 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-0c06ee5b-dca0-47d6-a7be-848770e88959 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] Calling method '.version_select at 0x7fcf4c9a3dc0>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:28.987642 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-0c06ee5b-dca0-47d6-a7be-848770e88959 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6" status: 202 len: 0 microversion: 2.1 time: 0.069221 May 13 15:05:28.988247 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 496/973] 10.222.0.99 () {58 vars in 1247 bytes} [Fri May 13 15:05:28 2022] DELETE /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:05:28.996357 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cdba3cfa-8317-4bc7-91f9-2895a1a57245 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] Calling method '.version_select at 0x7fcf4cbce0d0>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:29.043550 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-cdba3cfa-8317-4bc7-91f9-2895a1a57245 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6" status: 200 len: 353 microversion: 2.1 time: 0.050979 May 13 15:05:29.044158 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 478/974] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 15:05:28 2022] GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:05:30.056867 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9c9b8e3f-3e58-4e5a-8d4f-40fc3cbce9ee tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] Calling method '.version_select at 0x7fcf481dd430>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:30.104730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9c9b8e3f-3e58-4e5a-8d4f-40fc3cbce9ee tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6" status: 200 len: 353 microversion: 2.1 time: 0.052163 May 13 15:05:30.105434 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 497/975] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 15:05:30 2022] GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:05:31.118741 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e18f58b8-e701-4dfb-968c-0582baf816f8 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] Calling method '.version_select at 0x7fcf4cbaf9d0>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:05:31.152947 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-e18f58b8-e701-4dfb-968c-0582baf816f8 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] HTTP exception thrown: Volume 8a8be346-6bfb-40c7-bdec-4a8aee3171c6 could not be found. May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e18f58b8-e701-4dfb-968c-0582baf816f8 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] Request method failure captured: May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6 HTTP/1.1 May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnOxpsHfmrGCy1RSXMLALAD9JqpcuaicZ5ZgIIz26BRld6W9C70C2VW22Zf7vg5w6ZcBJ5aDMHiWtiZkwGVAEZm7DodtInJJ2U5w9S08aXvUACv3zORgOFLgiMmz2yfP4EFaG-qIUtBtWqhQX91wZmW7mKbritzcgUyWiNULjcVIQWM May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 02db8a3f6ac0450e985f728f78c72c11 May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-VolumesGetTestJSON-205198520 May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:05:31.155681 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:05:31.157657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_02db8a3f6ac0450e985f728f78c72c11", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/02db8a3f6ac0450e985f728f78c72c11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/02db8a3f6ac0450e985f728f78c72c11"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/02db8a3f6ac0450e985f728f78c72c11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:05:31.157657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-VolumesGetTestJSON-205198520 May 13 15:05:31.157657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 02db8a3f6ac0450e985f728f78c72c11 May 13 15:05:31.157657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-VolumesGetTestJSON-205198520 May 13 15:05:31.157657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-VolumesGetTestJSON-205198520-project May 13 15:05:31.157657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:05:31.157657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:05:31.157657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: f6f1bd9ffa134c65a3417fd74a754e25 May 13 15:05:31.157657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-VolumesGetTestJSON-205198520-project May 13 15:05:31.157657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: May 13 15:05:31.157657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Volume 8a8be346-6bfb-40c7-bdec-4a8aee3171c6 could not be found. May 13 15:05:31.157657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': '8a8be346-6bfb-40c7-bdec-4a8aee3171c6'} May 13 15:05:31.157657 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8a8be346-6bfb-40c7-bdec-4a8aee3171c6 could not be found. (HTTP 404) (Request-ID: req-52e323ee-b524-4538-9b44-3dfe74d77665) May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:05:31.158578 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 15:05:31.159846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8a8be346-6bfb-40c7-bdec-4a8aee3171c6 could not be found. May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 15:05:31.161176 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:05:31.163189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8a8be346-6bfb-40c7-bdec-4a8aee3171c6 could not be found. May 13 15:05:31.163189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:05:31.163189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:05:31.163189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:05:31.163189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:05:31.163189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:05:31.163189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:05:31.163189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:05:31.163189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:05:31.163189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8a8be346-6bfb-40c7-bdec-4a8aee3171c6 could not be found. May 13 15:05:31.163189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:05:31.163189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e18f58b8-e701-4dfb-968c-0582baf816f8 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] Returning 404 to user: Volume 8a8be346-6bfb-40c7-bdec-4a8aee3171c6 could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:05:31.163189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e18f58b8-e701-4dfb-968c-0582baf816f8 tempest-VolumesGetTestJSON-205198520 tempest-VolumesGetTestJSON-205198520-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6" status: 404 len: 109 microversion: 2.1 time: 0.043668 May 13 15:05:31.163189 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 479/976] 10.222.0.99 () {58 vars in 1244 bytes} [Fri May 13 15:05:31 2022] GET /compute/v2.1/os-volumes/8a8be346-6bfb-40c7-bdec-4a8aee3171c6 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:06:09.850997 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-889d4bae-9784-4701-92b6-bcb0297db499 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Action: 'create', calling method: .version_select at 0x7fcf4c9bb5e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-472517037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBON8pZKERz9itlkChNKUnH0K5o1IIA2eYRSmm/sKVPVMCZN+931imAjbTjy46YWfd8KWvFE9LNs0lf5FEtBf3AvzBjIJAP9z39AS3A2FGqDsPYlcX9wRby1G4Kqcoq9BhA=="}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:06:09.888542 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-889d4bae-9784-4701-92b6-bcb0297db499 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Getting quotas for project 76d2cdfd3aac43e3bb71ae6dda71da82. Resources: {'key_pairs'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 15:06:09.897022 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-889d4bae-9784-4701-92b6-bcb0297db499 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Getting quotas for user f713f767dbf14d10b9100ea52d093d6b and project 76d2cdfd3aac43e3bb71ae6dda71da82. Resources: {'key_pairs'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 15:06:09.941232 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-889d4bae-9784-4701-92b6-bcb0297db499 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.337980 May 13 15:06:09.942385 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 498/977] 10.222.0.99 () {60 vars in 1158 bytes} [Fri May 13 15:06:09 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:06:46.606926 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-17a264a7-7a74-4c78-9aa2-9833e53c7fca tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2059029907", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-472517037", "security_groups": [{"name": "tempest-secgroup-smoke-2127112240"}], "block_device_mapping_v2": [{"uuid": "0b97aad2-5f80-4371-b2cf-1dfe8db12539", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7ff3f59b-50c6-43ba-999e-35f70470c4f1"}]}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:06:46.796930 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.network.neutron [None req-17a264a7-7a74-4c78-9aa2-9833e53c7fca tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] validate_networks() for [('7ff3f59b-50c6-43ba-999e-35f70470c4f1', None, None, None, None, None)] {{(pid=117296) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 15:06:47.534854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-17a264a7-7a74-4c78-9aa2-9833e53c7fca tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Flavor limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 15:06:47.535273 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-17a264a7-7a74-4c78-9aa2-9833e53c7fca tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Image limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 15:06:47.535914 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-17a264a7-7a74-4c78-9aa2-9833e53c7fca tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Flavor pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 15:06:47.536364 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-17a264a7-7a74-4c78-9aa2-9833e53c7fca tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Image pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 15:06:47.536742 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-17a264a7-7a74-4c78-9aa2-9833e53c7fca tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 15:06:47.548801 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-17a264a7-7a74-4c78-9aa2-9833e53c7fca tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:47.549484 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-17a264a7-7a74-4c78-9aa2-9833e53c7fca tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:47.550455 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-17a264a7-7a74-4c78-9aa2-9833e53c7fca tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:47.551068 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-17a264a7-7a74-4c78-9aa2-9833e53c7fca tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:47.568053 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-17a264a7-7a74-4c78-9aa2-9833e53c7fca tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Getting quotas for project 76d2cdfd3aac43e3bb71ae6dda71da82. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 15:06:47.579573 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-17a264a7-7a74-4c78-9aa2-9833e53c7fca tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Getting quotas for user f713f767dbf14d10b9100ea52d093d6b and project 76d2cdfd3aac43e3bb71ae6dda71da82. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 15:06:47.652771 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-17a264a7-7a74-4c78-9aa2-9833e53c7fca tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Going to run 1 instances... {{(pid=117296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 15:06:47.654982 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-17a264a7-7a74-4c78-9aa2-9833e53c7fca tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0b97aad2-5f80-4371-b2cf-1dfe8db12539',volume_size=None,volume_type=None)] {{(pid=117296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 15:06:47.797889 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-17a264a7-7a74-4c78-9aa2-9833e53c7fca tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.196319 May 13 15:06:47.799024 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 480/978] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 15:06:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 15:06:47.808874 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-62a8dfdc-1adc-417c-998b-e19bbf56efc8 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:06:47.809563 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-62a8dfdc-1adc-417c-998b-e19bbf56efc8 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:06:47.911027 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-62a8dfdc-1adc-417c-998b-e19bbf56efc8 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:06:47.922009 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-62a8dfdc-1adc-417c-998b-e19bbf56efc8 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1094 microversion: 2.1 time: 0.115721 May 13 15:06:47.923641 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 499/979] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:06:47 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1094 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:06:48.940479 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1685148e-2bed-49b8-a801-c1d9ff69673d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:06:48.941688 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1685148e-2bed-49b8-a801-c1d9ff69673d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:06:48.949020 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1685148e-2bed-49b8-a801-c1d9ff69673d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:48.949752 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1685148e-2bed-49b8-a801-c1d9ff69673d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:48.950717 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1685148e-2bed-49b8-a801-c1d9ff69673d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:48.951412 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1685148e-2bed-49b8-a801-c1d9ff69673d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:49.034087 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1685148e-2bed-49b8-a801-c1d9ff69673d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:06:49.050741 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1685148e-2bed-49b8-a801-c1d9ff69673d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1192 microversion: 2.1 time: 0.113665 May 13 15:06:49.053923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 481/980] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:06:48 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1192 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 15:06:50.068371 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e42e27c0-8b22-47a6-8aa0-9910d9582fc1 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:06:50.068984 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e42e27c0-8b22-47a6-8aa0-9910d9582fc1 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:06:50.079144 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e42e27c0-8b22-47a6-8aa0-9910d9582fc1 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:50.079593 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e42e27c0-8b22-47a6-8aa0-9910d9582fc1 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:50.080440 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e42e27c0-8b22-47a6-8aa0-9910d9582fc1 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:50.080863 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e42e27c0-8b22-47a6-8aa0-9910d9582fc1 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:50.346889 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e42e27c0-8b22-47a6-8aa0-9910d9582fc1 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:06:50.355291 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e42e27c0-8b22-47a6-8aa0-9910d9582fc1 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1278 microversion: 2.1 time: 0.290741 May 13 15:06:50.356128 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 500/981] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:06:50 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1278 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 15:06:51.024561 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-8cfa7406-4580-4c24-8265-444542c2fcad req-90fbd94a-f6fb-4402-900c-3b63daf5a5ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa23852-8937-4694-a856-8a2485f2ecdc", "tag": "188bb0a4-da1b-42c4-b375-3cc526cda4ed"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:06:51.045117 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-8cfa7406-4580-4c24-8265-444542c2fcad req-90fbd94a-f6fb-4402-900c-3b63daf5a5ea service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:51.045879 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-8cfa7406-4580-4c24-8265-444542c2fcad req-90fbd94a-f6fb-4402-900c-3b63daf5a5ea service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:51.066360 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-8cfa7406-4580-4c24-8265-444542c2fcad req-90fbd94a-f6fb-4402-900c-3b63daf5a5ea service nova] Creating event network-changed:188bb0a4-da1b-42c4-b375-3cc526cda4ed for instance aaa23852-8937-4694-a856-8a2485f2ecdc on hv-cinder-83090 May 13 15:06:51.072173 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-8cfa7406-4580-4c24-8265-444542c2fcad req-90fbd94a-f6fb-4402-900c-3b63daf5a5ea service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053712 May 13 15:06:51.073487 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 482/982] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:06:51.373263 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-1358f329-f29d-4fe5-b42d-00690fbc242c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:06:51.374475 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-1358f329-f29d-4fe5-b42d-00690fbc242c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:06:51.385986 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1358f329-f29d-4fe5-b42d-00690fbc242c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:51.386645 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1358f329-f29d-4fe5-b42d-00690fbc242c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:51.387907 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1358f329-f29d-4fe5-b42d-00690fbc242c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:51.388562 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1358f329-f29d-4fe5-b42d-00690fbc242c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:51.630494 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-1358f329-f29d-4fe5-b42d-00690fbc242c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:06:51.639031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-1358f329-f29d-4fe5-b42d-00690fbc242c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1266 microversion: 2.1 time: 0.269625 May 13 15:06:51.639611 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 501/983] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:06:51 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:06:52.656833 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a7bc5467-fc12-485b-a9a0-8595cb111472 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:06:52.657604 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a7bc5467-fc12-485b-a9a0-8595cb111472 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:06:52.681757 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a7bc5467-fc12-485b-a9a0-8595cb111472 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:52.683710 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a7bc5467-fc12-485b-a9a0-8595cb111472 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:52.684557 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a7bc5467-fc12-485b-a9a0-8595cb111472 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:52.684997 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a7bc5467-fc12-485b-a9a0-8595cb111472 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:53.082073 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-a7bc5467-fc12-485b-a9a0-8595cb111472 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:06:53.091812 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a7bc5467-fc12-485b-a9a0-8595cb111472 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1266 microversion: 2.1 time: 0.439819 May 13 15:06:53.094440 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 483/984] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:06:52 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1266 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:06:54.110815 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-defc8f3f-49ca-4966-8eba-de8eb005221f tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:06:54.112212 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-defc8f3f-49ca-4966-8eba-de8eb005221f tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:06:54.119318 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-defc8f3f-49ca-4966-8eba-de8eb005221f tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:54.120211 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-defc8f3f-49ca-4966-8eba-de8eb005221f tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:54.121242 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-defc8f3f-49ca-4966-8eba-de8eb005221f tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:54.121897 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-defc8f3f-49ca-4966-8eba-de8eb005221f tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:54.604820 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-defc8f3f-49ca-4966-8eba-de8eb005221f tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:06:54.616708 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-defc8f3f-49ca-4966-8eba-de8eb005221f tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1266 microversion: 2.1 time: 0.508163 May 13 15:06:54.620331 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 502/985] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:06:54 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1266 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:06:55.638912 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f272d40b-7ae7-4f1f-89da-a2657dbc4d5e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:06:55.640149 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f272d40b-7ae7-4f1f-89da-a2657dbc4d5e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:06:55.647250 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f272d40b-7ae7-4f1f-89da-a2657dbc4d5e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:55.648124 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f272d40b-7ae7-4f1f-89da-a2657dbc4d5e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:55.649096 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f272d40b-7ae7-4f1f-89da-a2657dbc4d5e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:55.649683 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f272d40b-7ae7-4f1f-89da-a2657dbc4d5e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:55.849752 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f272d40b-7ae7-4f1f-89da-a2657dbc4d5e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:06:55.864168 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f272d40b-7ae7-4f1f-89da-a2657dbc4d5e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1266 microversion: 2.1 time: 0.230827 May 13 15:06:55.864754 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 484/986] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:06:55 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:06:56.881630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-eec4a775-a820-44d7-971d-84ffe003ce3a tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:06:56.882972 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-eec4a775-a820-44d7-971d-84ffe003ce3a tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:06:56.889604 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-eec4a775-a820-44d7-971d-84ffe003ce3a tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:56.890395 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-eec4a775-a820-44d7-971d-84ffe003ce3a tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:56.891516 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-eec4a775-a820-44d7-971d-84ffe003ce3a tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:56.892234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-eec4a775-a820-44d7-971d-84ffe003ce3a tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:57.122650 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-eec4a775-a820-44d7-971d-84ffe003ce3a tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:06:57.141727 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-eec4a775-a820-44d7-971d-84ffe003ce3a tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1266 microversion: 2.1 time: 0.264447 May 13 15:06:57.142693 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 503/987] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:06:56 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:06:58.158510 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cfbdd53a-c68b-4313-81bd-f2dd923ef513 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:06:58.159283 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-cfbdd53a-c68b-4313-81bd-f2dd923ef513 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:06:58.168111 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cfbdd53a-c68b-4313-81bd-f2dd923ef513 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:58.168878 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cfbdd53a-c68b-4313-81bd-f2dd923ef513 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:58.170025 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cfbdd53a-c68b-4313-81bd-f2dd923ef513 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:58.170693 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cfbdd53a-c68b-4313-81bd-f2dd923ef513 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:58.329586 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-cfbdd53a-c68b-4313-81bd-f2dd923ef513 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:06:58.339584 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-cfbdd53a-c68b-4313-81bd-f2dd923ef513 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1266 microversion: 2.1 time: 0.183764 May 13 15:06:58.340689 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 485/988] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:06:58 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:06:59.357035 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-b52926a3-4f5f-4412-8c5c-4c9c134350a4 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:06:59.358374 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-b52926a3-4f5f-4412-8c5c-4c9c134350a4 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:06:59.370253 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b52926a3-4f5f-4412-8c5c-4c9c134350a4 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:59.373179 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b52926a3-4f5f-4412-8c5c-4c9c134350a4 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:59.374003 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b52926a3-4f5f-4412-8c5c-4c9c134350a4 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:06:59.374449 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b52926a3-4f5f-4412-8c5c-4c9c134350a4 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:06:59.613470 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b52926a3-4f5f-4412-8c5c-4c9c134350a4 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:06:59.637875 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-b52926a3-4f5f-4412-8c5c-4c9c134350a4 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1266 microversion: 2.1 time: 0.281359 May 13 15:06:59.638520 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 504/989] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:06:59 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:00.655646 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e64fbe6a-2769-44c6-8a9d-1650f23f9fc3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:00.656800 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-e64fbe6a-2769-44c6-8a9d-1650f23f9fc3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:00.674279 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e64fbe6a-2769-44c6-8a9d-1650f23f9fc3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:00.674916 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e64fbe6a-2769-44c6-8a9d-1650f23f9fc3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:00.676757 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e64fbe6a-2769-44c6-8a9d-1650f23f9fc3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:00.677218 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e64fbe6a-2769-44c6-8a9d-1650f23f9fc3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:00.952444 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e64fbe6a-2769-44c6-8a9d-1650f23f9fc3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:00.968556 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e64fbe6a-2769-44c6-8a9d-1650f23f9fc3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1266 microversion: 2.1 time: 0.313003 May 13 15:07:00.973579 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 486/990] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:00 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:01.987565 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-fd169418-4b7c-4102-9f85-f88a18410ae2 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:01.989232 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-fd169418-4b7c-4102-9f85-f88a18410ae2 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:02.002199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fd169418-4b7c-4102-9f85-f88a18410ae2 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:02.002658 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fd169418-4b7c-4102-9f85-f88a18410ae2 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:02.005877 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fd169418-4b7c-4102-9f85-f88a18410ae2 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:02.006400 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fd169418-4b7c-4102-9f85-f88a18410ae2 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:02.309101 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-fd169418-4b7c-4102-9f85-f88a18410ae2 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:02.328113 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-fd169418-4b7c-4102-9f85-f88a18410ae2 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1266 microversion: 2.1 time: 0.344976 May 13 15:07:02.334178 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 505/991] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:01 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1266 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:03.352274 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f962b72b-e063-4d0e-b638-ab18b5d51aba tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:03.353654 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f962b72b-e063-4d0e-b638-ab18b5d51aba tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:03.362232 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f962b72b-e063-4d0e-b638-ab18b5d51aba tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:03.364341 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f962b72b-e063-4d0e-b638-ab18b5d51aba tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:03.365381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f962b72b-e063-4d0e-b638-ab18b5d51aba tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:03.366094 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f962b72b-e063-4d0e-b638-ab18b5d51aba tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:03.632638 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f962b72b-e063-4d0e-b638-ab18b5d51aba tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:03.648165 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f962b72b-e063-4d0e-b638-ab18b5d51aba tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1266 microversion: 2.1 time: 0.301360 May 13 15:07:03.650249 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 487/992] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:03 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:04.615450 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-20445a03-5f14-441f-90d6-fab781a8b496 req-e858cdf2-9df6-4469-94c6-a952eb7d45dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa23852-8937-4694-a856-8a2485f2ecdc", "name": "network-vif-plugged", "status": "completed", "tag": "188bb0a4-da1b-42c4-b375-3cc526cda4ed"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:07:04.625703 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-20445a03-5f14-441f-90d6-fab781a8b496 req-e858cdf2-9df6-4469-94c6-a952eb7d45dc service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:04.626139 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-20445a03-5f14-441f-90d6-fab781a8b496 req-e858cdf2-9df6-4469-94c6-a952eb7d45dc service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:04.668247 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a0a24f94-6e89-480b-9d57-a0de39dbccee tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:04.669416 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a0a24f94-6e89-480b-9d57-a0de39dbccee tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:04.689727 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a0a24f94-6e89-480b-9d57-a0de39dbccee tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:04.694878 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a0a24f94-6e89-480b-9d57-a0de39dbccee tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:04.696026 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a0a24f94-6e89-480b-9d57-a0de39dbccee tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:04.696799 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a0a24f94-6e89-480b-9d57-a0de39dbccee tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:04.897700 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-20445a03-5f14-441f-90d6-fab781a8b496 req-e858cdf2-9df6-4469-94c6-a952eb7d45dc service nova] Creating event network-vif-plugged:188bb0a4-da1b-42c4-b375-3cc526cda4ed for instance aaa23852-8937-4694-a856-8a2485f2ecdc on hv-cinder-83090 May 13 15:07:04.908361 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-20445a03-5f14-441f-90d6-fab781a8b496 req-e858cdf2-9df6-4469-94c6-a952eb7d45dc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.526556 May 13 15:07:04.909275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 506/993] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:07:04.948875 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-a0a24f94-6e89-480b-9d57-a0de39dbccee tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:04.957885 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a0a24f94-6e89-480b-9d57-a0de39dbccee tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1266 microversion: 2.1 time: 0.293573 May 13 15:07:04.967938 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 488/994] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:04 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:05.978060 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-14235a91-a826-464e-809f-e167e5e515c7 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:05.980104 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-14235a91-a826-464e-809f-e167e5e515c7 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:05.987336 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-14235a91-a826-464e-809f-e167e5e515c7 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:05.988314 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-14235a91-a826-464e-809f-e167e5e515c7 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:05.989880 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-14235a91-a826-464e-809f-e167e5e515c7 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:05.990726 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-14235a91-a826-464e-809f-e167e5e515c7 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:06.519536 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-14235a91-a826-464e-809f-e167e5e515c7 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:06.530663 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-14235a91-a826-464e-809f-e167e5e515c7 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1266 microversion: 2.1 time: 0.559309 May 13 15:07:06.541162 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 507/995] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:05 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1266 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 15:07:07.548886 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-4ecdee90-eeda-4422-819a-70753ede93cf tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:07.550693 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-4ecdee90-eeda-4422-819a-70753ede93cf tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:07.559540 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4ecdee90-eeda-4422-819a-70753ede93cf tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:07.560237 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4ecdee90-eeda-4422-819a-70753ede93cf tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:07.561169 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4ecdee90-eeda-4422-819a-70753ede93cf tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:07.562166 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4ecdee90-eeda-4422-819a-70753ede93cf tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:07.832458 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-4ecdee90-eeda-4422-819a-70753ede93cf tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:07.840165 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-4ecdee90-eeda-4422-819a-70753ede93cf tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1453 microversion: 2.1 time: 0.296681 May 13 15:07:07.845481 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 489/996] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:07 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1453 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:07.861115 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-0bab6766-e95b-4d30-a139-58c3afc56b1d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:07.862473 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-0bab6766-e95b-4d30-a139-58c3afc56b1d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:07.871622 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0bab6766-e95b-4d30-a139-58c3afc56b1d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:07.872271 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0bab6766-e95b-4d30-a139-58c3afc56b1d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:07.873064 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0bab6766-e95b-4d30-a139-58c3afc56b1d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:07.873497 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0bab6766-e95b-4d30-a139-58c3afc56b1d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:08.093257 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-0bab6766-e95b-4d30-a139-58c3afc56b1d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:08.106827 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-0bab6766-e95b-4d30-a139-58c3afc56b1d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1453 microversion: 2.1 time: 0.249463 May 13 15:07:08.108067 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 508/997] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:07 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1453 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:10.127281 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c54e36e3-d906-4c68-a742-187085ae01a2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Action: 'create', calling method: .version_select at 0x7fcf480d6670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-802583060", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvhUwJ0iV8xvrESCKjrkQSRomEcRmfRC+OhGp1mgc68yYpG8ABHcvGyafIrIOkClwDqiAd9OUxDrOcOyOoZaZLhhKdL3hnzvWV5vuruOOTjebdCl7vEOhD8rfAGhTdNiA=="}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:07:10.156201 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-c54e36e3-d906-4c68-a742-187085ae01a2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Getting quotas for project ad2d2bbcfc0c42659c9150d3ba5012af. Resources: {'key_pairs'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 15:07:10.163289 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-c54e36e3-d906-4c68-a742-187085ae01a2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Getting quotas for user c0e98de8d4724199b381482f91a06d74 and project ad2d2bbcfc0c42659c9150d3ba5012af. Resources: {'key_pairs'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 15:07:10.214132 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c54e36e3-d906-4c68-a742-187085ae01a2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.091071 May 13 15:07:10.215023 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 490/998] 10.222.0.99 () {60 vars in 1158 bytes} [Fri May 13 15:07:10 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:07:10.414033 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f58f5990-f28e-4631-b6b9-874ab7b0749b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-651159193", "imageRef": "130e4587-52be-465d-81ee-42199a12a461", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-802583060", "networks": [{"uuid": "c01f33a8-44eb-45f9-8769-a93e9f67a640"}]}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:07:10.489348 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.network.neutron [None req-f58f5990-f28e-4631-b6b9-874ab7b0749b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] validate_networks() for [('c01f33a8-44eb-45f9-8769-a93e9f67a640', None, None, None, None, None)] {{(pid=117295) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 15:07:11.651627 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-f58f5990-f28e-4631-b6b9-874ab7b0749b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Flavor limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 15:07:11.652692 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-f58f5990-f28e-4631-b6b9-874ab7b0749b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Image limits 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 15:07:11.653314 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-f58f5990-f28e-4631-b6b9-874ab7b0749b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Flavor pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 15:07:11.654925 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-f58f5990-f28e-4631-b6b9-874ab7b0749b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Image pref 0:0:0 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 15:07:11.655534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.virt.hardware [None req-f58f5990-f28e-4631-b6b9-874ab7b0749b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117295) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 15:07:11.680637 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f58f5990-f28e-4631-b6b9-874ab7b0749b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:11.685995 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f58f5990-f28e-4631-b6b9-874ab7b0749b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:11.687764 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f58f5990-f28e-4631-b6b9-874ab7b0749b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:11.688449 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f58f5990-f28e-4631-b6b9-874ab7b0749b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:11.736370 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-f58f5990-f28e-4631-b6b9-874ab7b0749b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Getting quotas for project ad2d2bbcfc0c42659c9150d3ba5012af. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 15:07:11.745410 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-f58f5990-f28e-4631-b6b9-874ab7b0749b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Getting quotas for user c0e98de8d4724199b381482f91a06d74 and project ad2d2bbcfc0c42659c9150d3ba5012af. Resources: {'instances', 'ram', 'cores'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 15:07:11.771367 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f58f5990-f28e-4631-b6b9-874ab7b0749b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Going to run 1 instances... {{(pid=117295) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 15:07:11.776837 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f58f5990-f28e-4631-b6b9-874ab7b0749b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='130e4587-52be-465d-81ee-42199a12a461',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117295) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 15:07:11.906382 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f58f5990-f28e-4631-b6b9-874ab7b0749b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.497661 May 13 15:07:11.907734 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 509/999] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 15:07:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 15:07:11.930025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-2d0751ab-5b9a-4f4d-baaf-ba370a1be66f tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:11.930684 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-2d0751ab-5b9a-4f4d-baaf-ba370a1be66f tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:11.984382 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-5f0b6d0c-9b95-4eeb-9cf8-85b73f0fc41f req-db9c0f91-b305-4f21-b5b7-26d7ea26d311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaa23852-8937-4694-a856-8a2485f2ecdc", "tag": "188bb0a4-da1b-42c4-b375-3cc526cda4ed"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:07:12.021556 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-5f0b6d0c-9b95-4eeb-9cf8-85b73f0fc41f req-db9c0f91-b305-4f21-b5b7-26d7ea26d311 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:12.022546 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-5f0b6d0c-9b95-4eeb-9cf8-85b73f0fc41f req-db9c0f91-b305-4f21-b5b7-26d7ea26d311 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:12.052853 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-5f0b6d0c-9b95-4eeb-9cf8-85b73f0fc41f req-db9c0f91-b305-4f21-b5b7-26d7ea26d311 service nova] Creating event network-changed:188bb0a4-da1b-42c4-b375-3cc526cda4ed for instance aaa23852-8937-4694-a856-8a2485f2ecdc on hv-cinder-83090 May 13 15:07:12.060763 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-5f0b6d0c-9b95-4eeb-9cf8-85b73f0fc41f req-db9c0f91-b305-4f21-b5b7-26d7ea26d311 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.410203 May 13 15:07:12.061307 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-2d0751ab-5b9a-4f4d-baaf-ba370a1be66f tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:12.067078 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 491/1000] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:07:12.069701 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-2d0751ab-5b9a-4f4d-baaf-ba370a1be66f tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1257 microversion: 2.1 time: 0.154737 May 13 15:07:12.071441 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 510/1001] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:11 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1257 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:13.088998 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-599ad407-5462-4d30-96b6-350806b1a983 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:13.090386 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-599ad407-5462-4d30-96b6-350806b1a983 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:13.155323 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-599ad407-5462-4d30-96b6-350806b1a983 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:13.162326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-599ad407-5462-4d30-96b6-350806b1a983 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1257 microversion: 2.1 time: 0.077971 May 13 15:07:13.162908 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 492/1002] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:13 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1257 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:13.499735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-96e881b2-75f0-4242-88c0-d78f07de0bdc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Action: 'create', calling method: .version_select at 0x7fcf4c9b3c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1791362010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElJFPnf5s5weRRH5mnYInmvxk57Y+x37ULvOukzSOxP+tKe/mgUNQGJOgMqYcFq3CLm3CUZthilQSAa0QyEySiRZ9AIfYXhwx1foKbkadJ2bq2Es9sEKvXmuG+9UhczUA=="}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:07:13.514619 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-96e881b2-75f0-4242-88c0-d78f07de0bdc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Getting quotas for project e43258e7d75e41f3b8763db3122c86b3. Resources: {'key_pairs'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 15:07:13.519156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.quota [None req-96e881b2-75f0-4242-88c0-d78f07de0bdc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Getting quotas for user 6eb4364f9eb6426581b983a436671b2e and project e43258e7d75e41f3b8763db3122c86b3. Resources: {'key_pairs'} {{(pid=117295) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 15:07:13.549184 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-96e881b2-75f0-4242-88c0-d78f07de0bdc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.151854 May 13 15:07:13.555831 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 511/1003] 10.222.0.99 () {60 vars in 1158 bytes} [Fri May 13 15:07:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:07:14.179923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-14bc3f45-8f5d-4c1f-9355-407065dd2037 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:14.180625 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-14bc3f45-8f5d-4c1f-9355-407065dd2037 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:14.249680 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-14bc3f45-8f5d-4c1f-9355-407065dd2037 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:14.260430 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-14bc3f45-8f5d-4c1f-9355-407065dd2037 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1257 microversion: 2.1 time: 0.084458 May 13 15:07:14.286315 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 493/1004] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:14 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1257 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:15.278503 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3e0a0865-1461-4a2e-b906-754731df942a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:15.279312 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3e0a0865-1461-4a2e-b906-754731df942a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:15.349652 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3e0a0865-1461-4a2e-b906-754731df942a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:15.359473 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3e0a0865-1461-4a2e-b906-754731df942a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1257 microversion: 2.1 time: 0.084662 May 13 15:07:15.360601 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 512/1005] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:15 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1257 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:16.376406 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e325317e-e263-42c9-8fe9-863950c4c6c8 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:16.376969 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-e325317e-e263-42c9-8fe9-863950c4c6c8 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:16.383819 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e325317e-e263-42c9-8fe9-863950c4c6c8 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:16.384979 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e325317e-e263-42c9-8fe9-863950c4c6c8 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:16.385775 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e325317e-e263-42c9-8fe9-863950c4c6c8 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:16.386218 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e325317e-e263-42c9-8fe9-863950c4c6c8 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:16.465855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e325317e-e263-42c9-8fe9-863950c4c6c8 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:16.481341 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e325317e-e263-42c9-8fe9-863950c4c6c8 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1261 microversion: 2.1 time: 0.108775 May 13 15:07:16.482761 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 494/1006] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:16 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1261 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:17.499254 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4ea70187-7c8b-4211-be89-3db0a084b5a7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:17.500547 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4ea70187-7c8b-4211-be89-3db0a084b5a7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:17.509351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4ea70187-7c8b-4211-be89-3db0a084b5a7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:17.510002 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4ea70187-7c8b-4211-be89-3db0a084b5a7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:17.511013 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4ea70187-7c8b-4211-be89-3db0a084b5a7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:17.511763 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4ea70187-7c8b-4211-be89-3db0a084b5a7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:17.599902 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4ea70187-7c8b-4211-be89-3db0a084b5a7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:17.609423 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4ea70187-7c8b-4211-be89-3db0a084b5a7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1315 microversion: 2.1 time: 0.113442 May 13 15:07:17.611414 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 513/1007] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:17 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1315 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:18.631570 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1cb0cbf4-d03e-4206-bd27-93ec56e25cec tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:18.632429 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1cb0cbf4-d03e-4206-bd27-93ec56e25cec tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:18.646485 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1cb0cbf4-d03e-4206-bd27-93ec56e25cec tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:18.647028 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1cb0cbf4-d03e-4206-bd27-93ec56e25cec tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:18.650469 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1cb0cbf4-d03e-4206-bd27-93ec56e25cec tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:18.651002 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1cb0cbf4-d03e-4206-bd27-93ec56e25cec tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:18.833734 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1cb0cbf4-d03e-4206-bd27-93ec56e25cec tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:18.842026 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1cb0cbf4-d03e-4206-bd27-93ec56e25cec tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.215505 May 13 15:07:18.848621 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 495/1008] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:18 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:19.861166 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-48235457-4958-4d08-bea0-bcfc964421f9 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:19.861717 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-48235457-4958-4d08-bea0-bcfc964421f9 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:19.868636 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-48235457-4958-4d08-bea0-bcfc964421f9 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:19.869083 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-48235457-4958-4d08-bea0-bcfc964421f9 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:19.869858 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-48235457-4958-4d08-bea0-bcfc964421f9 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:19.870296 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-48235457-4958-4d08-bea0-bcfc964421f9 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:20.016347 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-48235457-4958-4d08-bea0-bcfc964421f9 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:20.023922 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-48235457-4958-4d08-bea0-bcfc964421f9 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.166796 May 13 15:07:20.024752 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 514/1009] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:19 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:21.041630 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c793da24-e3c7-4c77-b6a1-0646a8c412ee tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:21.042218 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c793da24-e3c7-4c77-b6a1-0646a8c412ee tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:21.049294 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c793da24-e3c7-4c77-b6a1-0646a8c412ee tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:21.049930 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c793da24-e3c7-4c77-b6a1-0646a8c412ee tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:21.051055 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c793da24-e3c7-4c77-b6a1-0646a8c412ee tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:21.051498 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c793da24-e3c7-4c77-b6a1-0646a8c412ee tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:21.193627 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c793da24-e3c7-4c77-b6a1-0646a8c412ee tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:21.203026 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c793da24-e3c7-4c77-b6a1-0646a8c412ee tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.165442 May 13 15:07:21.203836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 496/1010] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:21 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:22.222042 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-038a8dbc-17d8-439e-beba-6f89e0064fb8 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:22.222829 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-038a8dbc-17d8-439e-beba-6f89e0064fb8 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:22.230219 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-038a8dbc-17d8-439e-beba-6f89e0064fb8 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:22.230660 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-038a8dbc-17d8-439e-beba-6f89e0064fb8 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:22.231821 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-038a8dbc-17d8-439e-beba-6f89e0064fb8 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:22.232300 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-038a8dbc-17d8-439e-beba-6f89e0064fb8 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:22.380783 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-038a8dbc-17d8-439e-beba-6f89e0064fb8 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:22.391851 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-038a8dbc-17d8-439e-beba-6f89e0064fb8 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.175413 May 13 15:07:22.392853 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 515/1011] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:22 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:23.410254 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5ae83969-ae78-49fa-9542-26ca2dd7b1a3 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:23.411037 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5ae83969-ae78-49fa-9542-26ca2dd7b1a3 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:23.418308 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5ae83969-ae78-49fa-9542-26ca2dd7b1a3 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:23.418828 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5ae83969-ae78-49fa-9542-26ca2dd7b1a3 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:23.419697 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5ae83969-ae78-49fa-9542-26ca2dd7b1a3 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:23.420250 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5ae83969-ae78-49fa-9542-26ca2dd7b1a3 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:23.572140 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5ae83969-ae78-49fa-9542-26ca2dd7b1a3 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:23.579816 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5ae83969-ae78-49fa-9542-26ca2dd7b1a3 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.173885 May 13 15:07:23.582913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 497/1012] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:23 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:24.598109 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-2ef4c6ba-c050-4753-8e73-c63cebdd9ef7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:24.598775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-2ef4c6ba-c050-4753-8e73-c63cebdd9ef7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:24.605158 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2ef4c6ba-c050-4753-8e73-c63cebdd9ef7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:24.605603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2ef4c6ba-c050-4753-8e73-c63cebdd9ef7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:24.606379 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2ef4c6ba-c050-4753-8e73-c63cebdd9ef7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:24.606811 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2ef4c6ba-c050-4753-8e73-c63cebdd9ef7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:24.757293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-2ef4c6ba-c050-4753-8e73-c63cebdd9ef7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:24.765483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-2ef4c6ba-c050-4753-8e73-c63cebdd9ef7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.171731 May 13 15:07:24.766170 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 516/1013] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:24 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:25.784483 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b1447c7b-69fc-4a82-896b-7aafe76c420c tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:25.785129 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b1447c7b-69fc-4a82-896b-7aafe76c420c tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:25.791756 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b1447c7b-69fc-4a82-896b-7aafe76c420c tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:25.792318 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b1447c7b-69fc-4a82-896b-7aafe76c420c tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:25.793152 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b1447c7b-69fc-4a82-896b-7aafe76c420c tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:25.793624 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b1447c7b-69fc-4a82-896b-7aafe76c420c tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:25.941690 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b1447c7b-69fc-4a82-896b-7aafe76c420c tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:25.949435 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b1447c7b-69fc-4a82-896b-7aafe76c420c tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.168923 May 13 15:07:25.950014 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 498/1014] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:25 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:26.970620 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e8e6ffad-d494-4f96-9ab6-def6a6e92c99 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:26.971571 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e8e6ffad-d494-4f96-9ab6-def6a6e92c99 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:26.983032 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e8e6ffad-d494-4f96-9ab6-def6a6e92c99 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:26.983753 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e8e6ffad-d494-4f96-9ab6-def6a6e92c99 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:26.985137 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e8e6ffad-d494-4f96-9ab6-def6a6e92c99 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:26.985870 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e8e6ffad-d494-4f96-9ab6-def6a6e92c99 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:27.119729 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e8e6ffad-d494-4f96-9ab6-def6a6e92c99 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:27.130010 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e8e6ffad-d494-4f96-9ab6-def6a6e92c99 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.166259 May 13 15:07:27.130541 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 517/1015] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:26 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:28.151369 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-bc1e6f02-fc89-4d4f-b5ee-ee950e25de98 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:28.152549 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-bc1e6f02-fc89-4d4f-b5ee-ee950e25de98 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:28.161337 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bc1e6f02-fc89-4d4f-b5ee-ee950e25de98 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:28.161786 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bc1e6f02-fc89-4d4f-b5ee-ee950e25de98 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:28.162567 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bc1e6f02-fc89-4d4f-b5ee-ee950e25de98 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:28.163001 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-bc1e6f02-fc89-4d4f-b5ee-ee950e25de98 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:28.313556 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-bc1e6f02-fc89-4d4f-b5ee-ee950e25de98 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:28.321846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-bc1e6f02-fc89-4d4f-b5ee-ee950e25de98 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.177051 May 13 15:07:28.322422 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 499/1016] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:28 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:29.344172 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-a920d67b-67f1-4806-b3b8-98a2fab37cac tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:29.345137 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-a920d67b-67f1-4806-b3b8-98a2fab37cac tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:29.352070 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a920d67b-67f1-4806-b3b8-98a2fab37cac tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:29.352526 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a920d67b-67f1-4806-b3b8-98a2fab37cac tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:29.353303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a920d67b-67f1-4806-b3b8-98a2fab37cac tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:29.353742 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a920d67b-67f1-4806-b3b8-98a2fab37cac tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:29.485878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-a920d67b-67f1-4806-b3b8-98a2fab37cac tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:29.494199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-a920d67b-67f1-4806-b3b8-98a2fab37cac tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.156710 May 13 15:07:29.494789 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 518/1017] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:29 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:30.511682 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3d0820bf-cb98-45f6-b936-bce833d34ffa tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:30.512352 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-3d0820bf-cb98-45f6-b936-bce833d34ffa tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:30.520878 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3d0820bf-cb98-45f6-b936-bce833d34ffa tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:30.521328 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3d0820bf-cb98-45f6-b936-bce833d34ffa tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:30.522089 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3d0820bf-cb98-45f6-b936-bce833d34ffa tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:30.522516 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3d0820bf-cb98-45f6-b936-bce833d34ffa tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:30.659066 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3d0820bf-cb98-45f6-b936-bce833d34ffa tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:30.670283 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-3d0820bf-cb98-45f6-b936-bce833d34ffa tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.162189 May 13 15:07:30.671057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 500/1018] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:30 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:31.690382 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d3bab17d-11fa-469e-996e-72cc1d38428d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:31.691082 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d3bab17d-11fa-469e-996e-72cc1d38428d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:31.699447 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d3bab17d-11fa-469e-996e-72cc1d38428d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:31.700062 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d3bab17d-11fa-469e-996e-72cc1d38428d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:31.701038 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d3bab17d-11fa-469e-996e-72cc1d38428d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:31.701582 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-d3bab17d-11fa-469e-996e-72cc1d38428d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:31.856220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d3bab17d-11fa-469e-996e-72cc1d38428d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:31.864215 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d3bab17d-11fa-469e-996e-72cc1d38428d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.179074 May 13 15:07:31.864781 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 519/1019] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:31 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:32.881230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b42d5b7c-d287-45be-a1c2-1ede893f5c87 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:32.881854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b42d5b7c-d287-45be-a1c2-1ede893f5c87 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:32.888834 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b42d5b7c-d287-45be-a1c2-1ede893f5c87 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:32.889281 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b42d5b7c-d287-45be-a1c2-1ede893f5c87 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:32.890289 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b42d5b7c-d287-45be-a1c2-1ede893f5c87 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:32.890724 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b42d5b7c-d287-45be-a1c2-1ede893f5c87 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:33.025616 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b42d5b7c-d287-45be-a1c2-1ede893f5c87 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:33.035408 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b42d5b7c-d287-45be-a1c2-1ede893f5c87 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.158005 May 13 15:07:33.036146 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 501/1020] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:32 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:33.084363 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-178e8080-a131-4458-af79-b068aebe468d req-dfc74c98-830b-4918-9e0d-2e6fa3236cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b824c80-f960-4b9c-be30-b484dec17b53", "tag": "a46c2165-63f8-4ffe-a613-741dad61b95c"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:07:33.093667 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-178e8080-a131-4458-af79-b068aebe468d req-dfc74c98-830b-4918-9e0d-2e6fa3236cd4 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:33.094643 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-178e8080-a131-4458-af79-b068aebe468d req-dfc74c98-830b-4918-9e0d-2e6fa3236cd4 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:33.127100 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-178e8080-a131-4458-af79-b068aebe468d req-dfc74c98-830b-4918-9e0d-2e6fa3236cd4 service nova] Creating event network-changed:a46c2165-63f8-4ffe-a613-741dad61b95c for instance 9b824c80-f960-4b9c-be30-b484dec17b53 on hv-cinder-83090 May 13 15:07:33.133409 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-178e8080-a131-4458-af79-b068aebe468d req-dfc74c98-830b-4918-9e0d-2e6fa3236cd4 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053441 May 13 15:07:33.134442 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 520/1021] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:07:34.057056 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-9b0603ba-ffd1-4fe4-b953-70a0f54132a5 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:34.058062 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-9b0603ba-ffd1-4fe4-b953-70a0f54132a5 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:34.067315 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9b0603ba-ffd1-4fe4-b953-70a0f54132a5 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:34.067759 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9b0603ba-ffd1-4fe4-b953-70a0f54132a5 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:34.068551 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9b0603ba-ffd1-4fe4-b953-70a0f54132a5 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:34.068980 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-9b0603ba-ffd1-4fe4-b953-70a0f54132a5 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:34.216740 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-9b0603ba-ffd1-4fe4-b953-70a0f54132a5 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:34.225179 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-9b0603ba-ffd1-4fe4-b953-70a0f54132a5 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.174797 May 13 15:07:34.225726 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 502/1022] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:34 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:35.250702 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-fdab5a5f-7022-4e0e-978a-6d49d9a65d38 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:35.251389 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-fdab5a5f-7022-4e0e-978a-6d49d9a65d38 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:35.257923 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fdab5a5f-7022-4e0e-978a-6d49d9a65d38 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:35.258378 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fdab5a5f-7022-4e0e-978a-6d49d9a65d38 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:35.259160 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fdab5a5f-7022-4e0e-978a-6d49d9a65d38 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:35.259593 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fdab5a5f-7022-4e0e-978a-6d49d9a65d38 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:35.395075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-fdab5a5f-7022-4e0e-978a-6d49d9a65d38 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:35.402700 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-fdab5a5f-7022-4e0e-978a-6d49d9a65d38 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.162446 May 13 15:07:35.403274 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 521/1023] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:35 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:36.424565 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3e1a26f4-83da-4267-9562-856ce5480c83 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:36.425587 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-3e1a26f4-83da-4267-9562-856ce5480c83 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:36.433381 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3e1a26f4-83da-4267-9562-856ce5480c83 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:36.433833 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3e1a26f4-83da-4267-9562-856ce5480c83 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:36.434617 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3e1a26f4-83da-4267-9562-856ce5480c83 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:36.435057 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3e1a26f4-83da-4267-9562-856ce5480c83 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:36.576824 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3e1a26f4-83da-4267-9562-856ce5480c83 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:36.586665 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-3e1a26f4-83da-4267-9562-856ce5480c83 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.168715 May 13 15:07:36.587232 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 503/1024] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:36 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:37.603542 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ec4e97e3-761a-49ed-a408-6d9f6e6e755d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:37.604161 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ec4e97e3-761a-49ed-a408-6d9f6e6e755d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:37.610875 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ec4e97e3-761a-49ed-a408-6d9f6e6e755d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:37.611309 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ec4e97e3-761a-49ed-a408-6d9f6e6e755d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:37.612139 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ec4e97e3-761a-49ed-a408-6d9f6e6e755d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:37.612569 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ec4e97e3-761a-49ed-a408-6d9f6e6e755d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:37.754525 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ec4e97e3-761a-49ed-a408-6d9f6e6e755d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:37.762272 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ec4e97e3-761a-49ed-a408-6d9f6e6e755d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.162578 May 13 15:07:37.762848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 522/1025] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:37 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:38.444304 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ea975a5f-543c-489e-8e30-8fce3858e560 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1830637055", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1791362010", "security_groups": [{"name": "tempest-secgroup-smoke-1421879795"}], "networks": [{"uuid": "9839731f-8a09-477e-b575-7a96f4ad0a11"}], "block_device_mapping_v2": [{"uuid": "cad393e7-15b9-4fc9-bfa3-700aa91a6d06", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:07:38.567096 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.network.neutron [None req-ea975a5f-543c-489e-8e30-8fce3858e560 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] validate_networks() for [('9839731f-8a09-477e-b575-7a96f4ad0a11', None, None, None, None, None)] {{(pid=117296) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 15:07:38.778833 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-0caa6932-fc90-4ac9-bad9-249d93cf94df tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:38.780183 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-0caa6932-fc90-4ac9-bad9-249d93cf94df tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:38.788311 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0caa6932-fc90-4ac9-bad9-249d93cf94df tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:38.788735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0caa6932-fc90-4ac9-bad9-249d93cf94df tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:38.789550 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0caa6932-fc90-4ac9-bad9-249d93cf94df tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:38.789990 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0caa6932-fc90-4ac9-bad9-249d93cf94df tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:38.984698 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-0caa6932-fc90-4ac9-bad9-249d93cf94df tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:38.993200 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-0caa6932-fc90-4ac9-bad9-249d93cf94df tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.218291 May 13 15:07:38.994009 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 523/1026] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:38 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:39.001802 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-ea975a5f-543c-489e-8e30-8fce3858e560 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Flavor limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 15:07:39.002221 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-ea975a5f-543c-489e-8e30-8fce3858e560 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Image limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 15:07:39.002697 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-ea975a5f-543c-489e-8e30-8fce3858e560 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Flavor pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 15:07:39.003164 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-ea975a5f-543c-489e-8e30-8fce3858e560 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Image pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 15:07:39.003711 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-ea975a5f-543c-489e-8e30-8fce3858e560 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 15:07:39.013824 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ea975a5f-543c-489e-8e30-8fce3858e560 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:39.014272 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ea975a5f-543c-489e-8e30-8fce3858e560 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:39.015078 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ea975a5f-543c-489e-8e30-8fce3858e560 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:39.015512 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ea975a5f-543c-489e-8e30-8fce3858e560 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:39.032558 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-ea975a5f-543c-489e-8e30-8fce3858e560 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Getting quotas for project e43258e7d75e41f3b8763db3122c86b3. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 15:07:39.036842 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-ea975a5f-543c-489e-8e30-8fce3858e560 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Getting quotas for user 6eb4364f9eb6426581b983a436671b2e and project e43258e7d75e41f3b8763db3122c86b3. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 15:07:39.101554 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ea975a5f-543c-489e-8e30-8fce3858e560 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Going to run 1 instances... {{(pid=117296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 15:07:39.103691 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ea975a5f-543c-489e-8e30-8fce3858e560 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cad393e7-15b9-4fc9-bfa3-700aa91a6d06',volume_size=None,volume_type=None)] {{(pid=117296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 15:07:39.245632 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ea975a5f-543c-489e-8e30-8fce3858e560 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.808080 May 13 15:07:39.246305 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 504/1027] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 15:07:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 15:07:39.256987 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-168b4928-bee1-4510-8b46-ae5f02e791e7 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:39.257601 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-168b4928-bee1-4510-8b46-ae5f02e791e7 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:39.313069 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-168b4928-bee1-4510-8b46-ae5f02e791e7 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:39.320006 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-168b4928-bee1-4510-8b46-ae5f02e791e7 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1089 microversion: 2.1 time: 0.067476 May 13 15:07:39.320565 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 524/1028] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:39 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:40.013855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-8298d7f6-52af-4440-a740-25a6c9b103e4 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:40.013855 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-8298d7f6-52af-4440-a740-25a6c9b103e4 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:40.020451 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8298d7f6-52af-4440-a740-25a6c9b103e4 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:40.021336 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8298d7f6-52af-4440-a740-25a6c9b103e4 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:40.021842 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8298d7f6-52af-4440-a740-25a6c9b103e4 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:40.022913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-8298d7f6-52af-4440-a740-25a6c9b103e4 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:40.159924 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-8298d7f6-52af-4440-a740-25a6c9b103e4 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:40.168371 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-8298d7f6-52af-4440-a740-25a6c9b103e4 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.160491 May 13 15:07:40.168924 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 505/1029] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:40 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:40.229539 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-bcf1a46f-5458-4a83-affc-0af578f57ee5 req-b7a9a685-bdc0-4c0e-87e7-04b3765cd535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b824c80-f960-4b9c-be30-b484dec17b53", "name": "network-vif-plugged", "status": "completed", "tag": "a46c2165-63f8-4ffe-a613-741dad61b95c"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:07:40.253449 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-bcf1a46f-5458-4a83-affc-0af578f57ee5 req-b7a9a685-bdc0-4c0e-87e7-04b3765cd535 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:40.254267 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-bcf1a46f-5458-4a83-affc-0af578f57ee5 req-b7a9a685-bdc0-4c0e-87e7-04b3765cd535 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:40.266060 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-bcf1a46f-5458-4a83-affc-0af578f57ee5 req-b7a9a685-bdc0-4c0e-87e7-04b3765cd535 service nova] Creating event network-vif-plugged:a46c2165-63f8-4ffe-a613-741dad61b95c for instance 9b824c80-f960-4b9c-be30-b484dec17b53 on hv-cinder-83090 May 13 15:07:40.271635 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-bcf1a46f-5458-4a83-affc-0af578f57ee5 req-b7a9a685-bdc0-4c0e-87e7-04b3765cd535 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046542 May 13 15:07:40.272385 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 525/1030] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:07:40.338376 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-79bcdb5d-8ecb-4666-bde8-08d79eaed7b2 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:40.338985 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-79bcdb5d-8ecb-4666-bde8-08d79eaed7b2 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:40.345505 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-79bcdb5d-8ecb-4666-bde8-08d79eaed7b2 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:40.345954 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-79bcdb5d-8ecb-4666-bde8-08d79eaed7b2 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:40.346720 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-79bcdb5d-8ecb-4666-bde8-08d79eaed7b2 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:40.347153 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-79bcdb5d-8ecb-4666-bde8-08d79eaed7b2 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:40.410899 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-79bcdb5d-8ecb-4666-bde8-08d79eaed7b2 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:40.419449 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-79bcdb5d-8ecb-4666-bde8-08d79eaed7b2 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1195 microversion: 2.1 time: 0.086054 May 13 15:07:40.420271 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 506/1031] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:40 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1195 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 15:07:41.185659 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-bbec683d-ebc2-4b39-bc7b-ca3e4740f068 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:41.186359 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-bbec683d-ebc2-4b39-bc7b-ca3e4740f068 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:41.193953 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bbec683d-ebc2-4b39-bc7b-ca3e4740f068 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:41.194645 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bbec683d-ebc2-4b39-bc7b-ca3e4740f068 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:41.195698 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bbec683d-ebc2-4b39-bc7b-ca3e4740f068 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:41.196151 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-bbec683d-ebc2-4b39-bc7b-ca3e4740f068 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:41.333691 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-bbec683d-ebc2-4b39-bc7b-ca3e4740f068 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:41.341166 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-bbec683d-ebc2-4b39-bc7b-ca3e4740f068 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.159762 May 13 15:07:41.341731 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 526/1032] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:41 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:41.437048 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cce02f92-c4e7-482d-b270-848fac7f17bd tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:41.437613 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-cce02f92-c4e7-482d-b270-848fac7f17bd tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:41.444133 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cce02f92-c4e7-482d-b270-848fac7f17bd tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:41.444825 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cce02f92-c4e7-482d-b270-848fac7f17bd tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:41.446062 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cce02f92-c4e7-482d-b270-848fac7f17bd tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:41.446506 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cce02f92-c4e7-482d-b270-848fac7f17bd tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:41.581518 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-cce02f92-c4e7-482d-b270-848fac7f17bd tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:41.589495 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-cce02f92-c4e7-482d-b270-848fac7f17bd tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1273 microversion: 2.1 time: 0.156357 May 13 15:07:41.590062 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 507/1033] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:41 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:42.326474 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-d8668504-f472-4b53-b4d3-1b44d380aad9 req-f77b4d6d-0806-45b9-9b36-2407aee7b40e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "895f9604-efa8-451b-9d41-b529fc177216", "tag": "b172f3f7-c5de-42d8-bc4e-ed1a26ad41f0"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:07:42.336521 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-d8668504-f472-4b53-b4d3-1b44d380aad9 req-f77b4d6d-0806-45b9-9b36-2407aee7b40e service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:42.337217 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-d8668504-f472-4b53-b4d3-1b44d380aad9 req-f77b4d6d-0806-45b9-9b36-2407aee7b40e service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:42.348574 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-d8668504-f472-4b53-b4d3-1b44d380aad9 req-f77b4d6d-0806-45b9-9b36-2407aee7b40e service nova] Creating event network-changed:b172f3f7-c5de-42d8-bc4e-ed1a26ad41f0 for instance 895f9604-efa8-451b-9d41-b529fc177216 on hv-cinder-83090 May 13 15:07:42.358129 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-d8668504-f472-4b53-b4d3-1b44d380aad9 req-f77b4d6d-0806-45b9-9b36-2407aee7b40e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035609 May 13 15:07:42.358854 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ad8421fe-19ad-4b35-80f8-d9a8f21642aa tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:42.358999 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 527/1034] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:07:42.359209 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ad8421fe-19ad-4b35-80f8-d9a8f21642aa tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:42.367196 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ad8421fe-19ad-4b35-80f8-d9a8f21642aa tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:42.367652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ad8421fe-19ad-4b35-80f8-d9a8f21642aa tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:42.368490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ad8421fe-19ad-4b35-80f8-d9a8f21642aa tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:42.368921 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ad8421fe-19ad-4b35-80f8-d9a8f21642aa tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:42.508322 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ad8421fe-19ad-4b35-80f8-d9a8f21642aa tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:42.516612 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ad8421fe-19ad-4b35-80f8-d9a8f21642aa tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1357 microversion: 2.1 time: 0.161631 May 13 15:07:42.517233 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 508/1035] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:42 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 15:07:42.607648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-a7db040f-62dd-4034-b339-77028c9e6508 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:42.608367 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-a7db040f-62dd-4034-b339-77028c9e6508 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:42.614715 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a7db040f-62dd-4034-b339-77028c9e6508 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:42.615156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a7db040f-62dd-4034-b339-77028c9e6508 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:42.616285 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a7db040f-62dd-4034-b339-77028c9e6508 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:42.616717 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-a7db040f-62dd-4034-b339-77028c9e6508 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:43.019405 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-a7db040f-62dd-4034-b339-77028c9e6508 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:43.027250 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-a7db040f-62dd-4034-b339-77028c9e6508 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1261 microversion: 2.1 time: 0.423747 May 13 15:07:43.027912 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 528/1036] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:42 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1261 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:43.536794 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-af45d00b-5006-46f0-99c3-1aeb88836bc6 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:43.537601 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-af45d00b-5006-46f0-99c3-1aeb88836bc6 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:43.544717 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-af45d00b-5006-46f0-99c3-1aeb88836bc6 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:43.545169 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-af45d00b-5006-46f0-99c3-1aeb88836bc6 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:43.545979 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-af45d00b-5006-46f0-99c3-1aeb88836bc6 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:43.546418 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-af45d00b-5006-46f0-99c3-1aeb88836bc6 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:43.689886 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-af45d00b-5006-46f0-99c3-1aeb88836bc6 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:43.698403 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-af45d00b-5006-46f0-99c3-1aeb88836bc6 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1548 microversion: 2.1 time: 0.166857 May 13 15:07:43.698975 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 509/1037] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:43 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:43.715293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-eb5006cc-458d-4339-82a5-2dff22baf9ce tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:43.715892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-eb5006cc-458d-4339-82a5-2dff22baf9ce tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:43.723259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-eb5006cc-458d-4339-82a5-2dff22baf9ce tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:43.723717 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-eb5006cc-458d-4339-82a5-2dff22baf9ce tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:43.724703 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-eb5006cc-458d-4339-82a5-2dff22baf9ce tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:43.725138 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-eb5006cc-458d-4339-82a5-2dff22baf9ce tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:43.859603 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-eb5006cc-458d-4339-82a5-2dff22baf9ce tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:43.869626 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-eb5006cc-458d-4339-82a5-2dff22baf9ce tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1548 microversion: 2.1 time: 0.158257 May 13 15:07:43.870199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 529/1038] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:43 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:43.885724 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cc7bd091-f660-4688-9f62-65e870644a74 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:43.889119 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-cc7bd091-f660-4688-9f62-65e870644a74 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:43.889887 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-cc7bd091-f660-4688-9f62-65e870644a74 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Searching by: {'deleted': False, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af'} {{(pid=117296) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 13 15:07:43.896975 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cc7bd091-f660-4688-9f62-65e870644a74 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:43.897579 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cc7bd091-f660-4688-9f62-65e870644a74 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:43.898645 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cc7bd091-f660-4688-9f62-65e870644a74 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:43.899085 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-cc7bd091-f660-4688-9f62-65e870644a74 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:43.991672 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.multi_cell_list [None req-cc7bd091-f660-4688-9f62-65e870644a74 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117296) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 13 15:07:44.045348 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ea27ecfb-a9bd-4e30-aed4-5ab910d47b3d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:44.046384 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ea27ecfb-a9bd-4e30-aed4-5ab910d47b3d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:44.052770 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ea27ecfb-a9bd-4e30-aed4-5ab910d47b3d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:44.053221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ea27ecfb-a9bd-4e30-aed4-5ab910d47b3d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:44.055038 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ea27ecfb-a9bd-4e30-aed4-5ab910d47b3d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:44.055478 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ea27ecfb-a9bd-4e30-aed4-5ab910d47b3d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:44.082661 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-cc7bd091-f660-4688-9f62-65e870644a74 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.200931 May 13 15:07:44.083270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 510/1039] 10.222.0.99 () {58 vars in 1124 bytes} [Fri May 13 15:07:43 2022] GET /compute/v2.1/servers => generated 342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:07:44.093932 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-45c2e512-9601-4592-92fe-af27feec93d7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:44.094542 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-45c2e512-9601-4592-92fe-af27feec93d7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:44.100926 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-45c2e512-9601-4592-92fe-af27feec93d7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:44.101409 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-45c2e512-9601-4592-92fe-af27feec93d7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:44.102269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-45c2e512-9601-4592-92fe-af27feec93d7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:44.102705 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-45c2e512-9601-4592-92fe-af27feec93d7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:44.243260 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ea27ecfb-a9bd-4e30-aed4-5ab910d47b3d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:44.250980 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ea27ecfb-a9bd-4e30-aed4-5ab910d47b3d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1261 microversion: 2.1 time: 0.209770 May 13 15:07:44.251588 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 530/1040] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:44 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1261 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:44.270341 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-45c2e512-9601-4592-92fe-af27feec93d7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:44.278357 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-45c2e512-9601-4592-92fe-af27feec93d7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1548 microversion: 2.1 time: 0.188409 May 13 15:07:44.278928 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 511/1041] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:44 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1548 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 15:07:45.268777 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-053ad04d-1b18-41dc-a1c5-0cb18397b4ec tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:45.269578 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-053ad04d-1b18-41dc-a1c5-0cb18397b4ec tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:45.276512 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-053ad04d-1b18-41dc-a1c5-0cb18397b4ec tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:45.276971 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-053ad04d-1b18-41dc-a1c5-0cb18397b4ec tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:45.277749 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-053ad04d-1b18-41dc-a1c5-0cb18397b4ec tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:45.278188 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-053ad04d-1b18-41dc-a1c5-0cb18397b4ec tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:45.423191 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-053ad04d-1b18-41dc-a1c5-0cb18397b4ec tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:45.431555 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-053ad04d-1b18-41dc-a1c5-0cb18397b4ec tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1261 microversion: 2.1 time: 0.166754 May 13 15:07:45.432180 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 531/1042] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:45 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:45.809577 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f55c1599-bc78-495e-8bf8-8f3e8f3cf67d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b1ae243-aa28-429c-bd7b-c36156bcf458"}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:07:45.810612 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f55c1599-bc78-495e-8bf8-8f3e8f3cf67d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:45.817160 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f55c1599-bc78-495e-8bf8-8f3e8f3cf67d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:45.817610 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f55c1599-bc78-495e-8bf8-8f3e8f3cf67d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:45.818371 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f55c1599-bc78-495e-8bf8-8f3e8f3cf67d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:45.818799 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f55c1599-bc78-495e-8bf8-8f3e8f3cf67d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:46.085599 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f55c1599-bc78-495e-8bf8-8f3e8f3cf67d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "POST /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279820 May 13 15:07:46.086224 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 512/1043] 10.222.0.99 () {60 vars in 1322 bytes} [Fri May 13 15:07:45 2022] POST /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 15:07:46.450246 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-35d5be22-b535-435d-bb78-5381313cf9d3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:46.450796 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-35d5be22-b535-435d-bb78-5381313cf9d3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:46.458518 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-35d5be22-b535-435d-bb78-5381313cf9d3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:46.459011 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-35d5be22-b535-435d-bb78-5381313cf9d3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:46.459934 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-35d5be22-b535-435d-bb78-5381313cf9d3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:46.460452 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-35d5be22-b535-435d-bb78-5381313cf9d3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:46.618644 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-35d5be22-b535-435d-bb78-5381313cf9d3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:46.630178 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-35d5be22-b535-435d-bb78-5381313cf9d3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1261 microversion: 2.1 time: 0.184396 May 13 15:07:46.631044 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 532/1044] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:46 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:47.653087 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a815e754-3097-4fdc-a6ab-6dc7be65cee3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:47.653823 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a815e754-3097-4fdc-a6ab-6dc7be65cee3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:47.661007 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a815e754-3097-4fdc-a6ab-6dc7be65cee3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:47.661482 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a815e754-3097-4fdc-a6ab-6dc7be65cee3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:47.662299 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a815e754-3097-4fdc-a6ab-6dc7be65cee3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:47.662756 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a815e754-3097-4fdc-a6ab-6dc7be65cee3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:47.822337 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-a815e754-3097-4fdc-a6ab-6dc7be65cee3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:47.830310 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a815e754-3097-4fdc-a6ab-6dc7be65cee3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1261 microversion: 2.1 time: 0.183428 May 13 15:07:47.830884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 513/1045] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:47 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:48.852152 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-135aecc4-6972-43ff-b8c2-7e11df6b5015 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:48.852733 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-135aecc4-6972-43ff-b8c2-7e11df6b5015 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:48.859995 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-135aecc4-6972-43ff-b8c2-7e11df6b5015 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:48.860493 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-135aecc4-6972-43ff-b8c2-7e11df6b5015 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:48.861291 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-135aecc4-6972-43ff-b8c2-7e11df6b5015 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:48.861769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-135aecc4-6972-43ff-b8c2-7e11df6b5015 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:49.017004 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-135aecc4-6972-43ff-b8c2-7e11df6b5015 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:49.029699 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-135aecc4-6972-43ff-b8c2-7e11df6b5015 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1261 microversion: 2.1 time: 0.183999 May 13 15:07:49.030276 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 533/1046] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:48 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:50.054566 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f6c47562-10a8-497d-a835-f6ebe0d00dc6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:50.055694 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f6c47562-10a8-497d-a835-f6ebe0d00dc6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:50.062515 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f6c47562-10a8-497d-a835-f6ebe0d00dc6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:50.062960 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f6c47562-10a8-497d-a835-f6ebe0d00dc6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:50.063744 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f6c47562-10a8-497d-a835-f6ebe0d00dc6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:50.064222 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f6c47562-10a8-497d-a835-f6ebe0d00dc6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:50.207023 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f6c47562-10a8-497d-a835-f6ebe0d00dc6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:50.215273 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f6c47562-10a8-497d-a835-f6ebe0d00dc6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1261 microversion: 2.1 time: 0.167275 May 13 15:07:50.215848 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 514/1047] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:50 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:51.233036 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-b0cba1f9-fbfe-4f52-860f-49f997940bb3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:51.233638 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-b0cba1f9-fbfe-4f52-860f-49f997940bb3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:51.240615 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b0cba1f9-fbfe-4f52-860f-49f997940bb3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:51.241055 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b0cba1f9-fbfe-4f52-860f-49f997940bb3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:51.241857 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b0cba1f9-fbfe-4f52-860f-49f997940bb3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:51.242277 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b0cba1f9-fbfe-4f52-860f-49f997940bb3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:51.381698 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b0cba1f9-fbfe-4f52-860f-49f997940bb3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:51.392954 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-b0cba1f9-fbfe-4f52-860f-49f997940bb3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1261 microversion: 2.1 time: 0.163558 May 13 15:07:51.393737 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 534/1048] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:51 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:52.412198 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3f213c00-fdc7-46f3-9902-013b7757739b tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:52.412810 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-3f213c00-fdc7-46f3-9902-013b7757739b tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:52.420043 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3f213c00-fdc7-46f3-9902-013b7757739b tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:52.420487 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3f213c00-fdc7-46f3-9902-013b7757739b tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:52.421254 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3f213c00-fdc7-46f3-9902-013b7757739b tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:52.421689 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3f213c00-fdc7-46f3-9902-013b7757739b tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:52.565144 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-3f213c00-fdc7-46f3-9902-013b7757739b tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:52.573625 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-3f213c00-fdc7-46f3-9902-013b7757739b tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1261 microversion: 2.1 time: 0.165359 May 13 15:07:52.574376 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 515/1049] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:52 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:53.595404 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-6fb593d8-ce0a-4c26-a267-0fb81da9e5d6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:53.596303 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-6fb593d8-ce0a-4c26-a267-0fb81da9e5d6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:53.605785 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6fb593d8-ce0a-4c26-a267-0fb81da9e5d6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:53.606237 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6fb593d8-ce0a-4c26-a267-0fb81da9e5d6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:53.607011 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6fb593d8-ce0a-4c26-a267-0fb81da9e5d6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:53.607443 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6fb593d8-ce0a-4c26-a267-0fb81da9e5d6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:53.747374 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-6fb593d8-ce0a-4c26-a267-0fb81da9e5d6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:53.754812 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-6fb593d8-ce0a-4c26-a267-0fb81da9e5d6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1261 microversion: 2.1 time: 0.166678 May 13 15:07:53.755348 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 535/1050] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:53 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:53.875777 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-272802ef-393b-495a-8884-654bb78cb23d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:53.876404 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-272802ef-393b-495a-8884-654bb78cb23d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:53.883126 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-272802ef-393b-495a-8884-654bb78cb23d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:53.883576 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-272802ef-393b-495a-8884-654bb78cb23d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:53.884547 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-272802ef-393b-495a-8884-654bb78cb23d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:53.885070 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-272802ef-393b-495a-8884-654bb78cb23d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:54.017963 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-272802ef-393b-495a-8884-654bb78cb23d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:54.026037 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-272802ef-393b-495a-8884-654bb78cb23d tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1594 microversion: 2.1 time: 0.154124 May 13 15:07:54.026607 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 516/1051] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:53 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:54.275626 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-aad34bbf-eb51-4ae6-a317-96a40332e99b req-4bc7a789-3b75-4865-a166-870f8a2e40d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895f9604-efa8-451b-9d41-b529fc177216", "name": "network-vif-plugged", "status": "completed", "tag": "b172f3f7-c5de-42d8-bc4e-ed1a26ad41f0"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:07:54.284491 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-aad34bbf-eb51-4ae6-a317-96a40332e99b req-4bc7a789-3b75-4865-a166-870f8a2e40d1 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:54.285060 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-aad34bbf-eb51-4ae6-a317-96a40332e99b req-4bc7a789-3b75-4865-a166-870f8a2e40d1 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:54.299091 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-aad34bbf-eb51-4ae6-a317-96a40332e99b req-4bc7a789-3b75-4865-a166-870f8a2e40d1 service nova] Creating event network-vif-plugged:b172f3f7-c5de-42d8-bc4e-ed1a26ad41f0 for instance 895f9604-efa8-451b-9d41-b529fc177216 on hv-cinder-83090 May 13 15:07:54.304233 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-aad34bbf-eb51-4ae6-a317-96a40332e99b req-4bc7a789-3b75-4865-a166-870f8a2e40d1 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033125 May 13 15:07:54.305007 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 536/1052] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:07:54.772179 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-6e47a44f-ee8e-4357-bb6d-f57c7c505a05 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:54.773615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-6e47a44f-ee8e-4357-bb6d-f57c7c505a05 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:54.780178 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e47a44f-ee8e-4357-bb6d-f57c7c505a05 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:54.780630 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e47a44f-ee8e-4357-bb6d-f57c7c505a05 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:54.781440 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e47a44f-ee8e-4357-bb6d-f57c7c505a05 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:54.781874 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-6e47a44f-ee8e-4357-bb6d-f57c7c505a05 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:54.916438 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-6e47a44f-ee8e-4357-bb6d-f57c7c505a05 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:54.923570 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-6e47a44f-ee8e-4357-bb6d-f57c7c505a05 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1261 microversion: 2.1 time: 0.155282 May 13 15:07:54.924175 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 517/1053] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:54 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:55.941160 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e7e4cd40-9031-44eb-abc8-00376fcb2d28 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:55.941823 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e7e4cd40-9031-44eb-abc8-00376fcb2d28 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:55.948573 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e7e4cd40-9031-44eb-abc8-00376fcb2d28 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:55.949041 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e7e4cd40-9031-44eb-abc8-00376fcb2d28 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:55.949811 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e7e4cd40-9031-44eb-abc8-00376fcb2d28 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:55.950239 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e7e4cd40-9031-44eb-abc8-00376fcb2d28 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:56.089823 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e7e4cd40-9031-44eb-abc8-00376fcb2d28 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:56.099263 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e7e4cd40-9031-44eb-abc8-00376fcb2d28 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1261 microversion: 2.1 time: 0.162886 May 13 15:07:56.099838 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 537/1054] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:55 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:56.183996 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-38c4e15b-b924-4559-9dd6-63c8dcdf1043 req-9b9b5da3-1c47-452f-80e3-4cf4c13b4821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b824c80-f960-4b9c-be30-b484dec17b53", "tag": "a46c2165-63f8-4ffe-a613-741dad61b95c"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:07:56.194735 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-38c4e15b-b924-4559-9dd6-63c8dcdf1043 req-9b9b5da3-1c47-452f-80e3-4cf4c13b4821 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:56.195684 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-38c4e15b-b924-4559-9dd6-63c8dcdf1043 req-9b9b5da3-1c47-452f-80e3-4cf4c13b4821 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:56.208015 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-38c4e15b-b924-4559-9dd6-63c8dcdf1043 req-9b9b5da3-1c47-452f-80e3-4cf4c13b4821 service nova] Creating event network-changed:a46c2165-63f8-4ffe-a613-741dad61b95c for instance 9b824c80-f960-4b9c-be30-b484dec17b53 on hv-cinder-83090 May 13 15:07:56.213710 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-38c4e15b-b924-4559-9dd6-63c8dcdf1043 req-9b9b5da3-1c47-452f-80e3-4cf4c13b4821 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034341 May 13 15:07:56.214327 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 518/1055] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:07:57.116554 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-39c2ce76-93cb-4c9d-9bee-8c2d5d129962 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:57.118510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-39c2ce76-93cb-4c9d-9bee-8c2d5d129962 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:57.128523 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-39c2ce76-93cb-4c9d-9bee-8c2d5d129962 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:57.129075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-39c2ce76-93cb-4c9d-9bee-8c2d5d129962 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:57.129755 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-39c2ce76-93cb-4c9d-9bee-8c2d5d129962 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:57.130340 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-39c2ce76-93cb-4c9d-9bee-8c2d5d129962 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:57.304650 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ef4ca0b9-e051-4fac-b364-62f7e4348058 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1888320509"}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:07:57.305223 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ef4ca0b9-e051-4fac-b364-62f7e4348058 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:57.311727 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ef4ca0b9-e051-4fac-b364-62f7e4348058 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:57.312318 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ef4ca0b9-e051-4fac-b364-62f7e4348058 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:57.313106 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ef4ca0b9-e051-4fac-b364-62f7e4348058 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:57.313513 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ef4ca0b9-e051-4fac-b364-62f7e4348058 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:57.322314 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-39c2ce76-93cb-4c9d-9bee-8c2d5d129962 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:57.330571 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-39c2ce76-93cb-4c9d-9bee-8c2d5d129962 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1444 microversion: 2.1 time: 0.218282 May 13 15:07:57.331356 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 538/1056] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:57 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1444 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:57.355643 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-dd450454-ec75-4f57-be3b-b961fa2b1c82 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:57.356421 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-dd450454-ec75-4f57-be3b-b961fa2b1c82 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:57.363048 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dd450454-ec75-4f57-be3b-b961fa2b1c82 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:57.363722 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dd450454-ec75-4f57-be3b-b961fa2b1c82 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:57.364792 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dd450454-ec75-4f57-be3b-b961fa2b1c82 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:57.365423 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dd450454-ec75-4f57-be3b-b961fa2b1c82 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:57.489489 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.network.security_group_api [None req-ef4ca0b9-e051-4fac-b364-62f7e4348058 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Adding security group 32b2bef0-478e-4e75-8f66-cbb4bd3e5f08 to port a46c2165-63f8-4ffe-a613-741dad61b95c May 13 15:07:57.572436 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-dd450454-ec75-4f57-be3b-b961fa2b1c82 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:57.580507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-dd450454-ec75-4f57-be3b-b961fa2b1c82 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1444 microversion: 2.1 time: 0.234920 May 13 15:07:57.581075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 539/1057] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:57 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1444 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:07:57.922635 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ef4ca0b9-e051-4fac-b364-62f7e4348058 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "POST /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/action" status: 202 len: 0 microversion: 2.1 time: 0.622880 May 13 15:07:57.924828 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 519/1058] 10.222.0.99 () {60 vars in 1277 bytes} [Fri May 13 15:07:57 2022] POST /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/action => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 15:07:57.937803 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-050a0c05-f53d-4fa5-9442-61223933e170 req-9433b450-c3d1-452c-aaaf-984fd55d08a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b824c80-f960-4b9c-be30-b484dec17b53", "tag": "a46c2165-63f8-4ffe-a613-741dad61b95c"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:07:57.940136 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-91856108-a375-4ea2-b8af-a45cbb424193 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:07:57.940991 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-91856108-a375-4ea2-b8af-a45cbb424193 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:07:57.961192 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-91856108-a375-4ea2-b8af-a45cbb424193 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:57.963765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-91856108-a375-4ea2-b8af-a45cbb424193 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:57.965861 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-91856108-a375-4ea2-b8af-a45cbb424193 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:57.968468 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-91856108-a375-4ea2-b8af-a45cbb424193 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:57.974925 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-050a0c05-f53d-4fa5-9442-61223933e170 req-9433b450-c3d1-452c-aaaf-984fd55d08a8 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:07:57.975972 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-050a0c05-f53d-4fa5-9442-61223933e170 req-9433b450-c3d1-452c-aaaf-984fd55d08a8 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:07:58.004524 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-050a0c05-f53d-4fa5-9442-61223933e170 req-9433b450-c3d1-452c-aaaf-984fd55d08a8 service nova] Creating event network-changed:a46c2165-63f8-4ffe-a613-741dad61b95c for instance 9b824c80-f960-4b9c-be30-b484dec17b53 on hv-cinder-83090 May 13 15:07:58.014988 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-050a0c05-f53d-4fa5-9442-61223933e170 req-9433b450-c3d1-452c-aaaf-984fd55d08a8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081952 May 13 15:07:58.020334 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 520/1059] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:07:58.179381 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-91856108-a375-4ea2-b8af-a45cbb424193 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:07:58.188547 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-91856108-a375-4ea2-b8af-a45cbb424193 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1760 microversion: 2.1 time: 0.259513 May 13 15:07:58.189198 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 540/1060] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:07:57 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1760 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:08:00.023018 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-d3540026-073d-4246-bdf6-34d262a11c36 req-bb03710b-a075-4ba4-9044-4109f8882bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "895f9604-efa8-451b-9d41-b529fc177216", "tag": "b172f3f7-c5de-42d8-bc4e-ed1a26ad41f0"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:08:00.031904 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-d3540026-073d-4246-bdf6-34d262a11c36 req-bb03710b-a075-4ba4-9044-4109f8882bc2 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:08:00.032352 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-d3540026-073d-4246-bdf6-34d262a11c36 req-bb03710b-a075-4ba4-9044-4109f8882bc2 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:08:00.046416 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-d3540026-073d-4246-bdf6-34d262a11c36 req-bb03710b-a075-4ba4-9044-4109f8882bc2 service nova] Creating event network-changed:b172f3f7-c5de-42d8-bc4e-ed1a26ad41f0 for instance 895f9604-efa8-451b-9d41-b529fc177216 on hv-cinder-83090 May 13 15:08:00.051495 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-d3540026-073d-4246-bdf6-34d262a11c36 req-bb03710b-a075-4ba4-9044-4109f8882bc2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033124 May 13 15:08:00.052135 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 521/1061] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:08:59.008980 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-6331badc-9b86-41f1-b942-1cf448da11e2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:08:59.010263 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-6331badc-9b86-41f1-b942-1cf448da11e2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:08:59.016683 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6331badc-9b86-41f1-b942-1cf448da11e2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:08:59.017145 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6331badc-9b86-41f1-b942-1cf448da11e2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:08:59.017923 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6331badc-9b86-41f1-b942-1cf448da11e2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:08:59.018347 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6331badc-9b86-41f1-b942-1cf448da11e2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:08:59.094098 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-6331badc-9b86-41f1-b942-1cf448da11e2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "POST /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/action" status: 202 len: 0 microversion: 2.1 time: 0.093990 May 13 15:08:59.095126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 541/1062] 10.222.0.99 () {60 vars in 1277 bytes} [Fri May 13 15:08:58 2022] POST /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:08:59.104048 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c5ccc5f1-878d-46c7-a939-9635b506a72a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:08:59.104777 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c5ccc5f1-878d-46c7-a939-9635b506a72a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:08:59.111778 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c5ccc5f1-878d-46c7-a939-9635b506a72a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:08:59.112271 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c5ccc5f1-878d-46c7-a939-9635b506a72a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:08:59.113067 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c5ccc5f1-878d-46c7-a939-9635b506a72a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:08:59.113495 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c5ccc5f1-878d-46c7-a939-9635b506a72a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:08:59.270808 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c5ccc5f1-878d-46c7-a939-9635b506a72a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:08:59.279512 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c5ccc5f1-878d-46c7-a939-9635b506a72a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1752 microversion: 2.1 time: 0.179788 May 13 15:08:59.280226 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 522/1063] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:08:59 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:00.303100 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3731fdbb-69a5-47a1-a3e8-ce811a484000 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:00.304522 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3731fdbb-69a5-47a1-a3e8-ce811a484000 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:00.315961 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3731fdbb-69a5-47a1-a3e8-ce811a484000 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:00.316727 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3731fdbb-69a5-47a1-a3e8-ce811a484000 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:00.318023 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3731fdbb-69a5-47a1-a3e8-ce811a484000 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:00.318767 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3731fdbb-69a5-47a1-a3e8-ce811a484000 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:00.467169 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3731fdbb-69a5-47a1-a3e8-ce811a484000 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:00.476510 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3731fdbb-69a5-47a1-a3e8-ce811a484000 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1757 microversion: 2.1 time: 0.180670 May 13 15:09:00.477264 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 542/1064] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:00 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:01.497925 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1bb897c9-a1c8-4a3b-bf95-8738f1207ee2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:01.498528 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1bb897c9-a1c8-4a3b-bf95-8738f1207ee2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:01.505610 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1bb897c9-a1c8-4a3b-bf95-8738f1207ee2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:01.506056 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1bb897c9-a1c8-4a3b-bf95-8738f1207ee2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:01.506836 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1bb897c9-a1c8-4a3b-bf95-8738f1207ee2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:01.507262 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1bb897c9-a1c8-4a3b-bf95-8738f1207ee2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:01.655903 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1bb897c9-a1c8-4a3b-bf95-8738f1207ee2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:01.664197 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1bb897c9-a1c8-4a3b-bf95-8738f1207ee2 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1757 microversion: 2.1 time: 0.171912 May 13 15:09:01.664751 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 523/1065] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:01 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:02.686073 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ca5b07d2-5532-46e9-ac1f-9415c138281a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:02.686712 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ca5b07d2-5532-46e9-ac1f-9415c138281a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:02.696760 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ca5b07d2-5532-46e9-ac1f-9415c138281a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:02.697306 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ca5b07d2-5532-46e9-ac1f-9415c138281a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:02.698372 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ca5b07d2-5532-46e9-ac1f-9415c138281a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:02.698864 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ca5b07d2-5532-46e9-ac1f-9415c138281a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:02.853472 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ca5b07d2-5532-46e9-ac1f-9415c138281a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:02.861878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ca5b07d2-5532-46e9-ac1f-9415c138281a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1757 microversion: 2.1 time: 0.182295 May 13 15:09:02.862444 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 543/1066] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:02 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:03.883288 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-2e4ff804-dd44-4ba4-8116-7231f69d8ce0 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:03.884259 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-2e4ff804-dd44-4ba4-8116-7231f69d8ce0 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:03.894907 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2e4ff804-dd44-4ba4-8116-7231f69d8ce0 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:03.895645 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2e4ff804-dd44-4ba4-8116-7231f69d8ce0 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:03.896960 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2e4ff804-dd44-4ba4-8116-7231f69d8ce0 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:03.897676 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2e4ff804-dd44-4ba4-8116-7231f69d8ce0 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:04.065779 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-2e4ff804-dd44-4ba4-8116-7231f69d8ce0 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:04.077267 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-2e4ff804-dd44-4ba4-8116-7231f69d8ce0 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1757 microversion: 2.1 time: 0.200493 May 13 15:09:04.077873 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 524/1067] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:03 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:05.095139 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-dacdf8e1-4033-4eb2-85a9-a02c0dd0c337 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:05.095757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-dacdf8e1-4033-4eb2-85a9-a02c0dd0c337 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:05.102434 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dacdf8e1-4033-4eb2-85a9-a02c0dd0c337 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:05.102908 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dacdf8e1-4033-4eb2-85a9-a02c0dd0c337 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:05.103685 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dacdf8e1-4033-4eb2-85a9-a02c0dd0c337 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:05.104163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-dacdf8e1-4033-4eb2-85a9-a02c0dd0c337 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:05.252663 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-dacdf8e1-4033-4eb2-85a9-a02c0dd0c337 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:05.261208 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-dacdf8e1-4033-4eb2-85a9-a02c0dd0c337 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1757 microversion: 2.1 time: 0.169983 May 13 15:09:05.261773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 544/1068] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:05 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:06.283235 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f6e78e7b-1328-40e3-a6ab-a0e04568671a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:06.284500 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f6e78e7b-1328-40e3-a6ab-a0e04568671a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:06.295105 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f6e78e7b-1328-40e3-a6ab-a0e04568671a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:06.295559 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f6e78e7b-1328-40e3-a6ab-a0e04568671a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:06.296374 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f6e78e7b-1328-40e3-a6ab-a0e04568671a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:06.296806 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f6e78e7b-1328-40e3-a6ab-a0e04568671a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:06.452994 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f6e78e7b-1328-40e3-a6ab-a0e04568671a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:06.464546 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f6e78e7b-1328-40e3-a6ab-a0e04568671a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1757 microversion: 2.1 time: 0.188189 May 13 15:09:06.465807 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 525/1069] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:06 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1757 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:07.487268 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-6d40fee5-6acd-4101-9cb1-4f40621c4b5b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:07.488323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-6d40fee5-6acd-4101-9cb1-4f40621c4b5b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:07.498360 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6d40fee5-6acd-4101-9cb1-4f40621c4b5b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:07.498806 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6d40fee5-6acd-4101-9cb1-4f40621c4b5b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:07.499589 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6d40fee5-6acd-4101-9cb1-4f40621c4b5b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:07.500058 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6d40fee5-6acd-4101-9cb1-4f40621c4b5b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:07.652528 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-6d40fee5-6acd-4101-9cb1-4f40621c4b5b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:07.665729 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-6d40fee5-6acd-4101-9cb1-4f40621c4b5b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1757 microversion: 2.1 time: 0.184943 May 13 15:09:07.666612 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 545/1070] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:07 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:08.686305 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-a7f07d64-d96b-46e3-9ad9-dea347659bfe tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:08.687037 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-a7f07d64-d96b-46e3-9ad9-dea347659bfe tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:08.695606 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a7f07d64-d96b-46e3-9ad9-dea347659bfe tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:08.696210 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a7f07d64-d96b-46e3-9ad9-dea347659bfe tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:08.697201 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a7f07d64-d96b-46e3-9ad9-dea347659bfe tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:08.697742 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-a7f07d64-d96b-46e3-9ad9-dea347659bfe tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:08.853788 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-a7f07d64-d96b-46e3-9ad9-dea347659bfe tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:08.866128 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-a7f07d64-d96b-46e3-9ad9-dea347659bfe tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1757 microversion: 2.1 time: 0.184469 May 13 15:09:08.866922 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 526/1071] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:08 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:09.888772 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-605896c5-f06f-4f74-a801-eef8420fc2b7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:09.889409 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-605896c5-f06f-4f74-a801-eef8420fc2b7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:09.897088 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-605896c5-f06f-4f74-a801-eef8420fc2b7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:09.897529 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-605896c5-f06f-4f74-a801-eef8420fc2b7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:09.898312 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-605896c5-f06f-4f74-a801-eef8420fc2b7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:09.898735 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-605896c5-f06f-4f74-a801-eef8420fc2b7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:10.140091 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-605896c5-f06f-4f74-a801-eef8420fc2b7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:10.148695 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-605896c5-f06f-4f74-a801-eef8420fc2b7 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1757 microversion: 2.1 time: 0.265891 May 13 15:09:10.149306 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 546/1072] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:09 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1757 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:11.166484 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1037e088-faa4-467f-9708-90296f0c2026 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:11.167121 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1037e088-faa4-467f-9708-90296f0c2026 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:11.173596 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1037e088-faa4-467f-9708-90296f0c2026 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:11.174050 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1037e088-faa4-467f-9708-90296f0c2026 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:11.174829 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1037e088-faa4-467f-9708-90296f0c2026 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:11.175266 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1037e088-faa4-467f-9708-90296f0c2026 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:11.333572 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1037e088-faa4-467f-9708-90296f0c2026 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:11.344815 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1037e088-faa4-467f-9708-90296f0c2026 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1760 microversion: 2.1 time: 0.182058 May 13 15:09:11.345686 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 527/1073] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:11 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1760 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:18.597588 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 15:09:18.598298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Fri May 13 15:09:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 15:09:38.670015 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-b1b6a743-34c2-46f7-ac90-d8d2f0d822dc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:38.670785 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-b1b6a743-34c2-46f7-ac90-d8d2f0d822dc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:38.679804 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b1b6a743-34c2-46f7-ac90-d8d2f0d822dc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:38.680444 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b1b6a743-34c2-46f7-ac90-d8d2f0d822dc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:38.681523 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b1b6a743-34c2-46f7-ac90-d8d2f0d822dc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:38.682030 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b1b6a743-34c2-46f7-ac90-d8d2f0d822dc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:38.709542 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-b1b6a743-34c2-46f7-ac90-d8d2f0d822dc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Going to try to terminate instance {{(pid=117295) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 15:09:38.793128 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-b1b6a743-34c2-46f7-ac90-d8d2f0d822dc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "DELETE /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 204 len: 0 microversion: 2.1 time: 0.129147 May 13 15:09:38.793672 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 547/1074] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:09:38 2022] DELETE /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 15:09:38.801837 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-d0db878d-488d-4abe-a0c4-89a1b2707abc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:38.802476 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-d0db878d-488d-4abe-a0c4-89a1b2707abc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:38.809545 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d0db878d-488d-4abe-a0c4-89a1b2707abc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:38.809999 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d0db878d-488d-4abe-a0c4-89a1b2707abc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:38.810754 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d0db878d-488d-4abe-a0c4-89a1b2707abc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:38.811182 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d0db878d-488d-4abe-a0c4-89a1b2707abc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:39.024261 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-d0db878d-488d-4abe-a0c4-89a1b2707abc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:39.032218 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-d0db878d-488d-4abe-a0c4-89a1b2707abc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1577 microversion: 2.1 time: 0.234090 May 13 15:09:39.032805 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 528/1075] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:38 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1577 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:40.053545 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-89c005cf-6603-4dc4-8e56-dab868cc146c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:40.054231 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-89c005cf-6603-4dc4-8e56-dab868cc146c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:40.060930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-89c005cf-6603-4dc4-8e56-dab868cc146c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:40.061367 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-89c005cf-6603-4dc4-8e56-dab868cc146c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:40.062141 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-89c005cf-6603-4dc4-8e56-dab868cc146c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:40.062688 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-89c005cf-6603-4dc4-8e56-dab868cc146c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:40.213048 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-89c005cf-6603-4dc4-8e56-dab868cc146c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:40.221061 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-89c005cf-6603-4dc4-8e56-dab868cc146c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1577 microversion: 2.1 time: 0.173339 May 13 15:09:40.221654 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 548/1076] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:40 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:41.240354 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5f29c271-6e6e-4bfa-9524-6a275c7adf43 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:41.240973 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5f29c271-6e6e-4bfa-9524-6a275c7adf43 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:41.247167 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5f29c271-6e6e-4bfa-9524-6a275c7adf43 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:41.247599 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5f29c271-6e6e-4bfa-9524-6a275c7adf43 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:41.248412 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5f29c271-6e6e-4bfa-9524-6a275c7adf43 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:41.248843 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5f29c271-6e6e-4bfa-9524-6a275c7adf43 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:41.314893 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5f29c271-6e6e-4bfa-9524-6a275c7adf43 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:41.323090 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5f29c271-6e6e-4bfa-9524-6a275c7adf43 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1509 microversion: 2.1 time: 0.087794 May 13 15:09:41.324044 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 529/1077] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:41 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1509 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:41.624698 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-cfc6b1db-1c91-40eb-91bd-8d3990fe9d84 req-d2f9008c-ce2f-4aec-9e3d-6cae675fab84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaa23852-8937-4694-a856-8a2485f2ecdc", "name": "network-vif-deleted", "tag": "188bb0a4-da1b-42c4-b375-3cc526cda4ed"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:09:41.635036 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-cfc6b1db-1c91-40eb-91bd-8d3990fe9d84 req-d2f9008c-ce2f-4aec-9e3d-6cae675fab84 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:41.635476 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-cfc6b1db-1c91-40eb-91bd-8d3990fe9d84 req-d2f9008c-ce2f-4aec-9e3d-6cae675fab84 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:41.647906 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-cfc6b1db-1c91-40eb-91bd-8d3990fe9d84 req-d2f9008c-ce2f-4aec-9e3d-6cae675fab84 service nova] Creating event network-vif-deleted:188bb0a4-da1b-42c4-b375-3cc526cda4ed for instance aaa23852-8937-4694-a856-8a2485f2ecdc on hv-cinder-83090 May 13 15:09:41.653679 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-cfc6b1db-1c91-40eb-91bd-8d3990fe9d84 req-d2f9008c-ce2f-4aec-9e3d-6cae675fab84 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032442 May 13 15:09:41.654585 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 549/1078] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:09:42.341598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-78df3736-4521-41db-a956-e8a26e22db52 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:42.342175 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-78df3736-4521-41db-a956-e8a26e22db52 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:42.348871 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-78df3736-4521-41db-a956-e8a26e22db52 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:42.349313 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-78df3736-4521-41db-a956-e8a26e22db52 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:42.350083 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-78df3736-4521-41db-a956-e8a26e22db52 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:42.350511 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-78df3736-4521-41db-a956-e8a26e22db52 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:42.384927 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-78df3736-4521-41db-a956-e8a26e22db52 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:42.385374 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-78df3736-4521-41db-a956-e8a26e22db52 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:42.385828 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.objects.instance [None req-78df3736-4521-41db-a956-e8a26e22db52 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lazy-loading 'fault' on Instance uuid aaa23852-8937-4694-a856-8a2485f2ecdc {{(pid=117296) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:09:42.432923 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-78df3736-4521-41db-a956-e8a26e22db52 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:42.441269 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-78df3736-4521-41db-a956-e8a26e22db52 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 200 len: 1230 microversion: 2.1 time: 0.103813 May 13 15:09:42.441922 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 530/1079] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:42 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:43.462882 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-54681710-007b-4ea9-be44-a3b025b1462c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:43.464236 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-54681710-007b-4ea9-be44-a3b025b1462c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:43.472963 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-54681710-007b-4ea9-be44-a3b025b1462c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:43.473473 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-54681710-007b-4ea9-be44-a3b025b1462c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:43.474449 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-54681710-007b-4ea9-be44-a3b025b1462c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:43.475006 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-54681710-007b-4ea9-be44-a3b025b1462c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:43.491722 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-54681710-007b-4ea9-be44-a3b025b1462c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] HTTP exception thrown: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-54681710-007b-4ea9-be44-a3b025b1462c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Request method failure captured: May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc HTTP/1.1 May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnPc7Z5jhMyDbj665qYKH3rXnG9ut-LCnu8vbhCVeTxs4katkuysQ3Ei1izp_YqX7IOv4eU0dDdfmPRnHfprKUzQ81g8-vyoF-AQqtr_s5bIXk8Lfdkj0smAgMS4IMrGrkr4lfBQqnBn9qL6xWUZaTUYQtB7sdTFTRgl8x0tRvItr0k May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 76d2cdfd3aac43e3bb71ae6dda71da82 May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-TestVolumeBootPattern-1878783554 May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:09:43.493412 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:09:43.495075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_76d2cdfd3aac43e3bb71ae6dda71da82", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/76d2cdfd3aac43e3bb71ae6dda71da82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/76d2cdfd3aac43e3bb71ae6dda71da82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/76d2cdfd3aac43e3bb71ae6dda71da82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:09:43.495075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-TestVolumeBootPattern-1878783554 May 13 15:09:43.495075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 76d2cdfd3aac43e3bb71ae6dda71da82 May 13 15:09:43.495075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-TestVolumeBootPattern-1878783554 May 13 15:09:43.495075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-TestVolumeBootPattern-1878783554-project May 13 15:09:43.495075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:09:43.495075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:09:43.495075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: f713f767dbf14d10b9100ea52d093d6b May 13 15:09:43.495075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-TestVolumeBootPattern-1878783554-project May 13 15:09:43.495075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:09:43.495075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. May 13 15:09:43.495075 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': 'aaa23852-8937-4694-a856-8a2485f2ecdc'} May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:09:43.496298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. May 13 15:09:43.497920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:09:43.499384 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-54681710-007b-4ea9-be44-a3b025b1462c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Returning 404 to user: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:09:43.499384 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-54681710-007b-4ea9-be44-a3b025b1462c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 404 len: 111 microversion: 2.1 time: 0.037461 May 13 15:09:43.499384 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 550/1080] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:43 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:09:43.594245 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-26716591-c19f-46cd-8581-2de5cf088784 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1969241623", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-472517037", "security_groups": [{"name": "tempest-secgroup-smoke-2127112240"}], "block_device_mapping_v2": [{"uuid": "0b97aad2-5f80-4371-b2cf-1dfe8db12539", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7ff3f59b-50c6-43ba-999e-35f70470c4f1"}]}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:09:43.724426 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.network.neutron [None req-26716591-c19f-46cd-8581-2de5cf088784 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] validate_networks() for [('7ff3f59b-50c6-43ba-999e-35f70470c4f1', None, None, None, None, None)] {{(pid=117296) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 15:09:44.131565 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-26716591-c19f-46cd-8581-2de5cf088784 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Flavor limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 15:09:44.132030 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-26716591-c19f-46cd-8581-2de5cf088784 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Image limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 15:09:44.132502 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-26716591-c19f-46cd-8581-2de5cf088784 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Flavor pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 15:09:44.132917 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-26716591-c19f-46cd-8581-2de5cf088784 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Image pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 15:09:44.133326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-26716591-c19f-46cd-8581-2de5cf088784 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 15:09:44.142727 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-26716591-c19f-46cd-8581-2de5cf088784 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:44.143179 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-26716591-c19f-46cd-8581-2de5cf088784 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:44.144021 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-26716591-c19f-46cd-8581-2de5cf088784 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:44.144617 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-26716591-c19f-46cd-8581-2de5cf088784 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:44.162186 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-26716591-c19f-46cd-8581-2de5cf088784 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Getting quotas for project 76d2cdfd3aac43e3bb71ae6dda71da82. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 15:09:44.166567 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-26716591-c19f-46cd-8581-2de5cf088784 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Getting quotas for user f713f767dbf14d10b9100ea52d093d6b and project 76d2cdfd3aac43e3bb71ae6dda71da82. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 15:09:44.225363 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-26716591-c19f-46cd-8581-2de5cf088784 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Going to run 1 instances... {{(pid=117296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 15:09:44.227486 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-26716591-c19f-46cd-8581-2de5cf088784 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0b97aad2-5f80-4371-b2cf-1dfe8db12539',volume_size=None,volume_type=None)] {{(pid=117296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 15:09:44.371142 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-26716591-c19f-46cd-8581-2de5cf088784 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.780827 May 13 15:09:44.371808 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 531/1081] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 15:09:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 15:09:44.382223 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-17f70b15-bd61-4bc4-9e46-06407cb3a76d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:44.382917 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-17f70b15-bd61-4bc4-9e46-06407cb3a76d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:44.440366 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-17f70b15-bd61-4bc4-9e46-06407cb3a76d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:44.446959 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-17f70b15-bd61-4bc4-9e46-06407cb3a76d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1094 microversion: 2.1 time: 0.068910 May 13 15:09:44.447514 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 551/1082] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:44 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:45.463955 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-d553795e-c15b-4a7b-8d82-7d0acd3c661c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:45.464552 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-d553795e-c15b-4a7b-8d82-7d0acd3c661c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:45.473614 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d553795e-c15b-4a7b-8d82-7d0acd3c661c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:45.474069 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d553795e-c15b-4a7b-8d82-7d0acd3c661c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:45.474874 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d553795e-c15b-4a7b-8d82-7d0acd3c661c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:45.475377 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d553795e-c15b-4a7b-8d82-7d0acd3c661c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:45.542052 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-d553795e-c15b-4a7b-8d82-7d0acd3c661c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:45.555832 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-d553795e-c15b-4a7b-8d82-7d0acd3c661c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1210 microversion: 2.1 time: 0.095736 May 13 15:09:45.556830 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 532/1083] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:45 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:46.579339 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-499b9973-5398-491f-85f3-c1dc4a136e29 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:46.579992 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-499b9973-5398-491f-85f3-c1dc4a136e29 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:46.587715 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-499b9973-5398-491f-85f3-c1dc4a136e29 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:46.588564 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-499b9973-5398-491f-85f3-c1dc4a136e29 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:46.589376 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-499b9973-5398-491f-85f3-c1dc4a136e29 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:46.589812 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-499b9973-5398-491f-85f3-c1dc4a136e29 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:46.724216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-499b9973-5398-491f-85f3-c1dc4a136e29 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:46.732028 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-499b9973-5398-491f-85f3-c1dc4a136e29 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1266 microversion: 2.1 time: 0.156526 May 13 15:09:46.732596 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 552/1084] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:46 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:47.134197 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-59d777a9-0cda-4e14-b20b-324d7cd76452 req-3a9b3d25-cb0b-42c9-b886-7ac8863ba4ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fec7e15e-143e-4e9f-b445-a558aff4daf9", "tag": "996acf21-cc9f-4966-8612-572a736b1a9c"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:09:47.143840 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-59d777a9-0cda-4e14-b20b-324d7cd76452 req-3a9b3d25-cb0b-42c9-b886-7ac8863ba4ce service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:47.146492 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-59d777a9-0cda-4e14-b20b-324d7cd76452 req-3a9b3d25-cb0b-42c9-b886-7ac8863ba4ce service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:47.166664 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-59d777a9-0cda-4e14-b20b-324d7cd76452 req-3a9b3d25-cb0b-42c9-b886-7ac8863ba4ce service nova] Creating event network-changed:996acf21-cc9f-4966-8612-572a736b1a9c for instance fec7e15e-143e-4e9f-b445-a558aff4daf9 on hv-cinder-83090 May 13 15:09:47.172823 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-59d777a9-0cda-4e14-b20b-324d7cd76452 req-3a9b3d25-cb0b-42c9-b886-7ac8863ba4ce service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042463 May 13 15:09:47.173981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 533/1085] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:09:47.754088 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-91889df0-5f77-48e7-b010-7caabb842e8e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:47.755027 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-91889df0-5f77-48e7-b010-7caabb842e8e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:47.761875 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-91889df0-5f77-48e7-b010-7caabb842e8e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:47.762323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-91889df0-5f77-48e7-b010-7caabb842e8e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:47.763093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-91889df0-5f77-48e7-b010-7caabb842e8e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:47.763526 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-91889df0-5f77-48e7-b010-7caabb842e8e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:47.911902 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-91889df0-5f77-48e7-b010-7caabb842e8e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:47.919855 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-91889df0-5f77-48e7-b010-7caabb842e8e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1266 microversion: 2.1 time: 0.172423 May 13 15:09:47.920462 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 553/1086] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:47 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:48.939706 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-7adbf08a-e162-4ecd-9e85-47c971e8729f tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:48.940434 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-7adbf08a-e162-4ecd-9e85-47c971e8729f tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:48.947493 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7adbf08a-e162-4ecd-9e85-47c971e8729f tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:48.947970 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7adbf08a-e162-4ecd-9e85-47c971e8729f tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:48.948752 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7adbf08a-e162-4ecd-9e85-47c971e8729f tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:48.949193 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-7adbf08a-e162-4ecd-9e85-47c971e8729f tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:49.104414 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-7adbf08a-e162-4ecd-9e85-47c971e8729f tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:49.112392 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-7adbf08a-e162-4ecd-9e85-47c971e8729f tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1266 microversion: 2.1 time: 0.177037 May 13 15:09:49.112983 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 534/1087] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:48 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:50.138618 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9c47d31f-2751-4ca3-995d-d1957d51029e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:50.139691 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9c47d31f-2751-4ca3-995d-d1957d51029e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:50.151085 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9c47d31f-2751-4ca3-995d-d1957d51029e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:50.151921 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9c47d31f-2751-4ca3-995d-d1957d51029e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:50.153223 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9c47d31f-2751-4ca3-995d-d1957d51029e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:50.154153 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9c47d31f-2751-4ca3-995d-d1957d51029e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:50.311652 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9c47d31f-2751-4ca3-995d-d1957d51029e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:50.320381 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9c47d31f-2751-4ca3-995d-d1957d51029e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1266 microversion: 2.1 time: 0.188362 May 13 15:09:50.320957 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 554/1088] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:50 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:51.343251 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c460ac5c-4581-4f03-b989-65f0f25ee71c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:51.344031 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c460ac5c-4581-4f03-b989-65f0f25ee71c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:51.352267 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c460ac5c-4581-4f03-b989-65f0f25ee71c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:51.352712 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c460ac5c-4581-4f03-b989-65f0f25ee71c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:51.353471 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c460ac5c-4581-4f03-b989-65f0f25ee71c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:51.353893 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c460ac5c-4581-4f03-b989-65f0f25ee71c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:51.488598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c460ac5c-4581-4f03-b989-65f0f25ee71c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:51.496496 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c460ac5c-4581-4f03-b989-65f0f25ee71c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1266 microversion: 2.1 time: 0.158557 May 13 15:09:51.497069 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 535/1089] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:51 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:52.514472 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-b30d11fc-bf4f-44a7-b9ac-e6b17c72ee5e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:52.514911 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-b30d11fc-bf4f-44a7-b9ac-e6b17c72ee5e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:52.521869 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b30d11fc-bf4f-44a7-b9ac-e6b17c72ee5e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:52.522321 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b30d11fc-bf4f-44a7-b9ac-e6b17c72ee5e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:52.523092 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b30d11fc-bf4f-44a7-b9ac-e6b17c72ee5e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:52.523526 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b30d11fc-bf4f-44a7-b9ac-e6b17c72ee5e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:52.671212 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b30d11fc-bf4f-44a7-b9ac-e6b17c72ee5e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:52.680721 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-b30d11fc-bf4f-44a7-b9ac-e6b17c72ee5e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1266 microversion: 2.1 time: 0.170774 May 13 15:09:52.681294 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 555/1090] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:52 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:53.701266 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-68e2cd3a-0ff8-4459-80e5-c6b3d5b38bf3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:53.702217 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-68e2cd3a-0ff8-4459-80e5-c6b3d5b38bf3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:53.714325 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-68e2cd3a-0ff8-4459-80e5-c6b3d5b38bf3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:53.715041 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-68e2cd3a-0ff8-4459-80e5-c6b3d5b38bf3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:53.716367 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-68e2cd3a-0ff8-4459-80e5-c6b3d5b38bf3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:53.717079 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-68e2cd3a-0ff8-4459-80e5-c6b3d5b38bf3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:53.861028 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-68e2cd3a-0ff8-4459-80e5-c6b3d5b38bf3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:53.872826 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-68e2cd3a-0ff8-4459-80e5-c6b3d5b38bf3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1266 microversion: 2.1 time: 0.177939 May 13 15:09:53.873616 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 536/1091] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:53 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:54.895079 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-174a8ca8-662f-4ae3-ba91-c81675a98679 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:54.895855 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-174a8ca8-662f-4ae3-ba91-c81675a98679 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:54.903169 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-174a8ca8-662f-4ae3-ba91-c81675a98679 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:54.903666 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-174a8ca8-662f-4ae3-ba91-c81675a98679 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:54.904560 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-174a8ca8-662f-4ae3-ba91-c81675a98679 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:54.905035 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-174a8ca8-662f-4ae3-ba91-c81675a98679 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:55.042915 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-174a8ca8-662f-4ae3-ba91-c81675a98679 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:55.052021 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-174a8ca8-662f-4ae3-ba91-c81675a98679 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1266 microversion: 2.1 time: 0.163630 May 13 15:09:55.052592 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 556/1092] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:54 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:56.071402 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c94f0b27-a369-4f9e-8b15-55c1c66a9b53 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:56.072114 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c94f0b27-a369-4f9e-8b15-55c1c66a9b53 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:56.079408 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c94f0b27-a369-4f9e-8b15-55c1c66a9b53 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:56.079900 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c94f0b27-a369-4f9e-8b15-55c1c66a9b53 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:56.080786 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c94f0b27-a369-4f9e-8b15-55c1c66a9b53 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:56.081263 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c94f0b27-a369-4f9e-8b15-55c1c66a9b53 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:56.225048 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c94f0b27-a369-4f9e-8b15-55c1c66a9b53 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:56.233332 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c94f0b27-a369-4f9e-8b15-55c1c66a9b53 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1266 microversion: 2.1 time: 0.167088 May 13 15:09:56.233913 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 537/1093] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:56 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:57.252040 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-84988014-e73e-4c14-9c76-d47789a2d2fd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:57.252753 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-84988014-e73e-4c14-9c76-d47789a2d2fd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:57.261327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-84988014-e73e-4c14-9c76-d47789a2d2fd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:57.261855 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-84988014-e73e-4c14-9c76-d47789a2d2fd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:57.262765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-84988014-e73e-4c14-9c76-d47789a2d2fd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:57.263259 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-84988014-e73e-4c14-9c76-d47789a2d2fd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:57.402443 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-84988014-e73e-4c14-9c76-d47789a2d2fd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:57.410287 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-84988014-e73e-4c14-9c76-d47789a2d2fd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1266 microversion: 2.1 time: 0.162882 May 13 15:09:57.411083 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 557/1094] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:57 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:58.431434 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-2d65dcef-e3dd-4fed-a491-443e08054874 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:58.432099 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-2d65dcef-e3dd-4fed-a491-443e08054874 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:58.438898 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2d65dcef-e3dd-4fed-a491-443e08054874 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:58.439343 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2d65dcef-e3dd-4fed-a491-443e08054874 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:58.440137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2d65dcef-e3dd-4fed-a491-443e08054874 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:58.440565 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2d65dcef-e3dd-4fed-a491-443e08054874 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:58.578305 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-2d65dcef-e3dd-4fed-a491-443e08054874 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:58.586702 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-2d65dcef-e3dd-4fed-a491-443e08054874 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1266 microversion: 2.1 time: 0.161209 May 13 15:09:58.587267 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 538/1095] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:58 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:09:58.938458 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-55032d10-fd10-4651-88fd-fe1122a97ccd req-f644913c-64d0-49a4-a972-810c43bde169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec7e15e-143e-4e9f-b445-a558aff4daf9", "name": "network-vif-plugged", "status": "completed", "tag": "996acf21-cc9f-4966-8612-572a736b1a9c"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:09:58.946655 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-55032d10-fd10-4651-88fd-fe1122a97ccd req-f644913c-64d0-49a4-a972-810c43bde169 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:58.947194 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-55032d10-fd10-4651-88fd-fe1122a97ccd req-f644913c-64d0-49a4-a972-810c43bde169 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:58.958549 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-55032d10-fd10-4651-88fd-fe1122a97ccd req-f644913c-64d0-49a4-a972-810c43bde169 service nova] Creating event network-vif-plugged:996acf21-cc9f-4966-8612-572a736b1a9c for instance fec7e15e-143e-4e9f-b445-a558aff4daf9 on hv-cinder-83090 May 13 15:09:58.963836 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-55032d10-fd10-4651-88fd-fe1122a97ccd req-f644913c-64d0-49a4-a972-810c43bde169 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029207 May 13 15:09:58.964457 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 558/1096] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:09:59.605637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e1f4eeb1-e207-4d79-af9f-5fce98134b0d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:09:59.606256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-e1f4eeb1-e207-4d79-af9f-5fce98134b0d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:09:59.613991 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e1f4eeb1-e207-4d79-af9f-5fce98134b0d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:59.614524 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e1f4eeb1-e207-4d79-af9f-5fce98134b0d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:59.615445 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e1f4eeb1-e207-4d79-af9f-5fce98134b0d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:09:59.616089 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e1f4eeb1-e207-4d79-af9f-5fce98134b0d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:09:59.762535 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e1f4eeb1-e207-4d79-af9f-5fce98134b0d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:09:59.769847 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e1f4eeb1-e207-4d79-af9f-5fce98134b0d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1266 microversion: 2.1 time: 0.169016 May 13 15:09:59.770414 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 539/1097] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:09:59 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:00.797825 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-95d19212-8eea-40e2-ba89-7a8799a310ac tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:00.798846 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-95d19212-8eea-40e2-ba89-7a8799a310ac tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:00.807520 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-95d19212-8eea-40e2-ba89-7a8799a310ac tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:00.807989 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-95d19212-8eea-40e2-ba89-7a8799a310ac tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:00.808766 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-95d19212-8eea-40e2-ba89-7a8799a310ac tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:00.809196 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-95d19212-8eea-40e2-ba89-7a8799a310ac tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:00.955186 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-95d19212-8eea-40e2-ba89-7a8799a310ac tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:00.963667 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-95d19212-8eea-40e2-ba89-7a8799a310ac tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1266 microversion: 2.1 time: 0.173822 May 13 15:10:00.964291 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 559/1098] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:00 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:01.985818 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c613e3a1-b3e3-4725-a896-35d6bcbbc1bc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:01.986744 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c613e3a1-b3e3-4725-a896-35d6bcbbc1bc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:01.997596 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c613e3a1-b3e3-4725-a896-35d6bcbbc1bc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:01.998343 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c613e3a1-b3e3-4725-a896-35d6bcbbc1bc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:01.999620 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c613e3a1-b3e3-4725-a896-35d6bcbbc1bc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:02.000402 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c613e3a1-b3e3-4725-a896-35d6bcbbc1bc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:02.146603 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c613e3a1-b3e3-4725-a896-35d6bcbbc1bc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:02.155938 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c613e3a1-b3e3-4725-a896-35d6bcbbc1bc tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1452 microversion: 2.1 time: 0.176650 May 13 15:10:02.156513 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 540/1099] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:01 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:02.172187 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-8f3c55a5-81b4-4a8f-b86d-899b856eddd4 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:02.172744 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-8f3c55a5-81b4-4a8f-b86d-899b856eddd4 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:02.179410 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8f3c55a5-81b4-4a8f-b86d-899b856eddd4 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:02.179856 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8f3c55a5-81b4-4a8f-b86d-899b856eddd4 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:02.180657 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8f3c55a5-81b4-4a8f-b86d-899b856eddd4 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:02.181095 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-8f3c55a5-81b4-4a8f-b86d-899b856eddd4 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:02.315842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-8f3c55a5-81b4-4a8f-b86d-899b856eddd4 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:02.327559 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-8f3c55a5-81b4-4a8f-b86d-899b856eddd4 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1452 microversion: 2.1 time: 0.158979 May 13 15:10:02.328390 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 560/1100] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:02 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:04.056243 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-0adbb9af-865f-4c25-af62-31401f77142e req-8befe629-42c6-4f32-8d09-e1445e50149c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fec7e15e-143e-4e9f-b445-a558aff4daf9", "tag": "996acf21-cc9f-4966-8612-572a736b1a9c"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:10:04.064070 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-0adbb9af-865f-4c25-af62-31401f77142e req-8befe629-42c6-4f32-8d09-e1445e50149c service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:04.064516 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-0adbb9af-865f-4c25-af62-31401f77142e req-8befe629-42c6-4f32-8d09-e1445e50149c service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:04.076074 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-0adbb9af-865f-4c25-af62-31401f77142e req-8befe629-42c6-4f32-8d09-e1445e50149c service nova] Creating event network-changed:996acf21-cc9f-4966-8612-572a736b1a9c for instance fec7e15e-143e-4e9f-b445-a558aff4daf9 on hv-cinder-83090 May 13 15:10:04.082054 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-0adbb9af-865f-4c25-af62-31401f77142e req-8befe629-42c6-4f32-8d09-e1445e50149c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085513 May 13 15:10:04.083196 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 541/1101] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:10:14.823243 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e68b442a-8023-44e6-b101-ae4fd588f205 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1888320509"}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:10:14.824872 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e68b442a-8023-44e6-b101-ae4fd588f205 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:14.835109 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e68b442a-8023-44e6-b101-ae4fd588f205 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:14.835842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e68b442a-8023-44e6-b101-ae4fd588f205 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:14.837467 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e68b442a-8023-44e6-b101-ae4fd588f205 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:14.838221 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e68b442a-8023-44e6-b101-ae4fd588f205 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:14.972765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.network.security_group_api [None req-e68b442a-8023-44e6-b101-ae4fd588f205 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Removing security group 32b2bef0-478e-4e75-8f66-cbb4bd3e5f08 from port a46c2165-63f8-4ffe-a613-741dad61b95c May 13 15:10:15.341984 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e68b442a-8023-44e6-b101-ae4fd588f205 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "POST /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/action" status: 202 len: 0 microversion: 2.1 time: 0.525301 May 13 15:10:15.345743 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 561/1102] 10.222.0.99 () {60 vars in 1277 bytes} [Fri May 13 15:10:14 2022] POST /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:10:15.351402 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-f380ee6d-fff3-442a-9f21-5cb31c5f37d2 req-a5d02145-a3f5-419c-891b-f82046a11f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b824c80-f960-4b9c-be30-b484dec17b53", "tag": "a46c2165-63f8-4ffe-a613-741dad61b95c"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:10:15.368150 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-f380ee6d-fff3-442a-9f21-5cb31c5f37d2 req-a5d02145-a3f5-419c-891b-f82046a11f84 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:15.368602 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-f380ee6d-fff3-442a-9f21-5cb31c5f37d2 req-a5d02145-a3f5-419c-891b-f82046a11f84 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:15.395663 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-f380ee6d-fff3-442a-9f21-5cb31c5f37d2 req-a5d02145-a3f5-419c-891b-f82046a11f84 service nova] Creating event network-changed:a46c2165-63f8-4ffe-a613-741dad61b95c for instance 9b824c80-f960-4b9c-be30-b484dec17b53 on hv-cinder-83090 May 13 15:10:15.410512 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-f380ee6d-fff3-442a-9f21-5cb31c5f37d2 req-a5d02145-a3f5-419c-891b-f82046a11f84 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063675 May 13 15:10:15.411137 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 542/1103] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:10:16.828138 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-218d512f-4029-41c1-9e6b-dc0de87fbd49 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:16.828671 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-218d512f-4029-41c1-9e6b-dc0de87fbd49 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:16.834920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-218d512f-4029-41c1-9e6b-dc0de87fbd49 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:16.835375 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-218d512f-4029-41c1-9e6b-dc0de87fbd49 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:16.836196 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-218d512f-4029-41c1-9e6b-dc0de87fbd49 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:16.836630 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-218d512f-4029-41c1-9e6b-dc0de87fbd49 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:16.925765 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-218d512f-4029-41c1-9e6b-dc0de87fbd49 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lazy-loading 'services' on Instance uuid 9b824c80-f960-4b9c-be30-b484dec17b53 {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:10:17.004996 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-218d512f-4029-41c1-9e6b-dc0de87fbd49 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "DELETE /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/os-volume_attachments/7b1ae243-aa28-429c-bd7b-c36156bcf458" status: 202 len: 0 microversion: 2.1 time: 0.181570 May 13 15:10:17.005751 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 562/1104] 10.222.0.99 () {58 vars in 1415 bytes} [Fri May 13 15:10:16 2022] DELETE /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/os-volume_attachments/7b1ae243-aa28-429c-bd7b-c36156bcf458 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:10:17.015359 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1a503262-d0ad-4494-b522-261edfc8e12b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:17.016569 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1a503262-d0ad-4494-b522-261edfc8e12b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:17.023979 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1a503262-d0ad-4494-b522-261edfc8e12b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:17.024208 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1a503262-d0ad-4494-b522-261edfc8e12b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:17.024929 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1a503262-d0ad-4494-b522-261edfc8e12b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:17.025364 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1a503262-d0ad-4494-b522-261edfc8e12b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:17.072395 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1a503262-d0ad-4494-b522-261edfc8e12b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061876 May 13 15:10:17.072922 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 543/1105] 10.222.0.99 () {58 vars in 1301 bytes} [Fri May 13 15:10:17 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:10:17.353184 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3b19183b-ed77-406e-9ed4-70cf155ead2a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:10:17.354024 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3b19183b-ed77-406e-9ed4-70cf155ead2a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:17.360983 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3b19183b-ed77-406e-9ed4-70cf155ead2a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:17.361429 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3b19183b-ed77-406e-9ed4-70cf155ead2a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:17.362209 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3b19183b-ed77-406e-9ed4-70cf155ead2a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:17.362640 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3b19183b-ed77-406e-9ed4-70cf155ead2a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:17.385353 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.objects.instance [None req-3b19183b-ed77-406e-9ed4-70cf155ead2a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lazy-loading 'flavor' on Instance uuid 895f9604-efa8-451b-9d41-b529fc177216 {{(pid=117295) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 15:10:17.428654 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-096e9cd3-139f-4520-a5d4-f26cbaddbe93 req-d16800bd-1559-4e82-a578-5c7b1be35f28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b824c80-f960-4b9c-be30-b484dec17b53", "tag": "a46c2165-63f8-4ffe-a613-741dad61b95c"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:10:17.438305 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-096e9cd3-139f-4520-a5d4-f26cbaddbe93 req-d16800bd-1559-4e82-a578-5c7b1be35f28 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:17.439017 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-096e9cd3-139f-4520-a5d4-f26cbaddbe93 req-d16800bd-1559-4e82-a578-5c7b1be35f28 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:17.452193 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-096e9cd3-139f-4520-a5d4-f26cbaddbe93 req-d16800bd-1559-4e82-a578-5c7b1be35f28 service nova] Creating event network-changed:a46c2165-63f8-4ffe-a613-741dad61b95c for instance 9b824c80-f960-4b9c-be30-b484dec17b53 on hv-cinder-83090 May 13 15:10:17.457206 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-096e9cd3-139f-4520-a5d4-f26cbaddbe93 req-d16800bd-1559-4e82-a578-5c7b1be35f28 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032537 May 13 15:10:17.458023 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 544/1106] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:10:17.470825 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3b19183b-ed77-406e-9ed4-70cf155ead2a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "POST /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216/action" status: 202 len: 0 microversion: 2.1 time: 0.124630 May 13 15:10:17.471755 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 563/1107] 10.222.0.99 () {60 vars in 1277 bytes} [Fri May 13 15:10:17 2022] POST /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:10:17.482218 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ece07c6e-967e-4cbf-a7e8-209e281614bc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:17.482994 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ece07c6e-967e-4cbf-a7e8-209e281614bc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:17.490169 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ece07c6e-967e-4cbf-a7e8-209e281614bc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:17.490660 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ece07c6e-967e-4cbf-a7e8-209e281614bc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:17.491493 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ece07c6e-967e-4cbf-a7e8-209e281614bc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:17.491937 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ece07c6e-967e-4cbf-a7e8-209e281614bc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:17.632335 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ece07c6e-967e-4cbf-a7e8-209e281614bc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:17.640687 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ece07c6e-967e-4cbf-a7e8-209e281614bc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1568 microversion: 2.1 time: 0.162887 May 13 15:10:17.641423 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 545/1108] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:17 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:18.086060 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4cc34a19-949f-4e86-83b3-9a3c3b5eee02 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:18.087460 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4cc34a19-949f-4e86-83b3-9a3c3b5eee02 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:18.094070 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4cc34a19-949f-4e86-83b3-9a3c3b5eee02 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:18.094530 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4cc34a19-949f-4e86-83b3-9a3c3b5eee02 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:18.095298 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4cc34a19-949f-4e86-83b3-9a3c3b5eee02 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:18.095717 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4cc34a19-949f-4e86-83b3-9a3c3b5eee02 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:18.126491 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4cc34a19-949f-4e86-83b3-9a3c3b5eee02 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044855 May 13 15:10:18.127606 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 564/1109] 10.222.0.99 () {58 vars in 1301 bytes} [Fri May 13 15:10:18 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:10:18.662490 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-78245193-6363-47f7-8b7b-fdd800a137f8 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:18.663485 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-78245193-6363-47f7-8b7b-fdd800a137f8 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:18.674828 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-78245193-6363-47f7-8b7b-fdd800a137f8 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:18.675566 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-78245193-6363-47f7-8b7b-fdd800a137f8 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:18.676894 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-78245193-6363-47f7-8b7b-fdd800a137f8 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:18.677612 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-78245193-6363-47f7-8b7b-fdd800a137f8 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:18.819884 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-78245193-6363-47f7-8b7b-fdd800a137f8 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:18.829677 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-78245193-6363-47f7-8b7b-fdd800a137f8 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1568 microversion: 2.1 time: 0.173764 May 13 15:10:18.830318 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 546/1110] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:18 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:19.141373 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-48525cac-ac7d-459c-ba43-8874f8c3c234 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:19.142317 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-48525cac-ac7d-459c-ba43-8874f8c3c234 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:19.149723 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-48525cac-ac7d-459c-ba43-8874f8c3c234 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:19.150229 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-48525cac-ac7d-459c-ba43-8874f8c3c234 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:19.151091 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-48525cac-ac7d-459c-ba43-8874f8c3c234 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:19.151574 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-48525cac-ac7d-459c-ba43-8874f8c3c234 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:19.181775 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-48525cac-ac7d-459c-ba43-8874f8c3c234 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045299 May 13 15:10:19.182323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 565/1111] 10.222.0.99 () {58 vars in 1301 bytes} [Fri May 13 15:10:19 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 15:10:19.192436 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3dc53471-47bd-49cc-858e-5944d4108a7a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:19.192930 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-3dc53471-47bd-49cc-858e-5944d4108a7a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:19.199015 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3dc53471-47bd-49cc-858e-5944d4108a7a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:19.199500 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3dc53471-47bd-49cc-858e-5944d4108a7a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:19.200301 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3dc53471-47bd-49cc-858e-5944d4108a7a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:19.200731 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3dc53471-47bd-49cc-858e-5944d4108a7a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:19.275139 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-3dc53471-47bd-49cc-858e-5944d4108a7a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] HTTP exception thrown: Instance 9b824c80-f960-4b9c-be30-b484dec17b53 is not attached to volume 7b1ae243-aa28-429c-bd7b-c36156bcf458 May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3dc53471-47bd-49cc-858e-5944d4108a7a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Request method failure captured: May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: DELETE /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/os-volume_attachments/7b1ae243-aa28-429c-bd7b-c36156bcf458 HTTP/1.1 May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnQJBzR-sM2gxzAv2ApJ_wvwy95atbRm57vtYKOJ9EiJqWJOoCgvCFTWXeqnV6udoUXPDV_Ha9L1xK77TUjwPeEzfGysedZhNOG_5gQ4hCkRjmiYhGZXaJpN_8gFuqJwBQBloVpwXo4DoysuvjWtDzjtjm1gAiS_YEVhCub4bPVcmCE May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: ad2d2bbcfc0c42659c9150d3ba5012af May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-TestMinimumBasicScenario-1124200552 May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:10:19.277652 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:10:19.279456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ad2d2bbcfc0c42659c9150d3ba5012af", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ad2d2bbcfc0c42659c9150d3ba5012af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ad2d2bbcfc0c42659c9150d3ba5012af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ad2d2bbcfc0c42659c9150d3ba5012af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:10:19.279456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-TestMinimumBasicScenario-1124200552 May 13 15:10:19.279456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: ad2d2bbcfc0c42659c9150d3ba5012af May 13 15:10:19.279456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1124200552 May 13 15:10:19.279456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-TestMinimumBasicScenario-1124200552-project May 13 15:10:19.279456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:10:19.279456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:10:19.279456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: c0e98de8d4724199b381482f91a06d74 May 13 15:10:19.279456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-TestMinimumBasicScenario-1124200552-project May 13 15:10:19.279456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 15:10:19.279456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance 9b824c80-f960-4b9c-be30-b484dec17b53 is not attached to volume 7b1ae243-aa28-429c-bd7b-c36156bcf458 May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'server_id': '9b824c80-f960-4b9c-be30-b484dec17b53', 'id': '7b1ae243-aa28-429c-bd7b-c36156bcf458'} May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7b1ae243-aa28-429c-bd7b-c36156bcf458. May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:10:19.280405 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:10:19.281939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:10:19.281939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 13 15:10:19.281939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 13 15:10:19.281939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b824c80-f960-4b9c-be30-b484dec17b53 is not attached to volume 7b1ae243-aa28-429c-bd7b-c36156bcf458 May 13 15:10:19.281939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:10:19.281939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:10:19.281939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:10:19.281939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:10:19.281939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:10:19.281939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:10:19.281939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:10:19.281939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:10:19.281939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b824c80-f960-4b9c-be30-b484dec17b53 is not attached to volume 7b1ae243-aa28-429c-bd7b-c36156bcf458 May 13 15:10:19.281939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:10:19.281939 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3dc53471-47bd-49cc-858e-5944d4108a7a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Returning 404 to user: Instance 9b824c80-f960-4b9c-be30-b484dec17b53 is not attached to volume 7b1ae243-aa28-429c-bd7b-c36156bcf458 {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:10:19.283110 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-3dc53471-47bd-49cc-858e-5944d4108a7a tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "DELETE /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/os-volume_attachments/7b1ae243-aa28-429c-bd7b-c36156bcf458" status: 404 len: 154 microversion: 2.1 time: 0.090690 May 13 15:10:19.283110 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 547/1112] 10.222.0.99 () {58 vars in 1415 bytes} [Fri May 13 15:10:19 2022] DELETE /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53/os-volume_attachments/7b1ae243-aa28-429c-bd7b-c36156bcf458 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:10:19.857367 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-837bf134-0c52-4f0d-ba76-2bc5b45ee572 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:19.858164 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-837bf134-0c52-4f0d-ba76-2bc5b45ee572 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:19.864819 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-837bf134-0c52-4f0d-ba76-2bc5b45ee572 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:19.865270 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-837bf134-0c52-4f0d-ba76-2bc5b45ee572 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:19.866076 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-837bf134-0c52-4f0d-ba76-2bc5b45ee572 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:19.866480 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-837bf134-0c52-4f0d-ba76-2bc5b45ee572 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:20.002370 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-837bf134-0c52-4f0d-ba76-2bc5b45ee572 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:20.010667 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-837bf134-0c52-4f0d-ba76-2bc5b45ee572 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1568 microversion: 2.1 time: 0.160739 May 13 15:10:20.011233 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 566/1113] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:19 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:20.430450 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c64f2b3a-abc2-44aa-b548-362bcfaa2838 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:20.430981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c64f2b3a-abc2-44aa-b548-362bcfaa2838 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:20.440029 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c64f2b3a-abc2-44aa-b548-362bcfaa2838 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:20.440632 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c64f2b3a-abc2-44aa-b548-362bcfaa2838 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:20.441805 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c64f2b3a-abc2-44aa-b548-362bcfaa2838 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:20.442448 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c64f2b3a-abc2-44aa-b548-362bcfaa2838 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:20.469519 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c64f2b3a-abc2-44aa-b548-362bcfaa2838 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Going to try to terminate instance {{(pid=117296) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 15:10:20.551627 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c64f2b3a-abc2-44aa-b548-362bcfaa2838 tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "DELETE /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 204 len: 0 microversion: 2.1 time: 0.126771 May 13 15:10:20.552337 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 548/1114] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:10:20 2022] DELETE /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 15:10:20.562442 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-1902c8d5-ba83-4a29-a765-8a45530b57fb tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:20.563052 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-1902c8d5-ba83-4a29-a765-8a45530b57fb tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:20.571434 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1902c8d5-ba83-4a29-a765-8a45530b57fb tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:20.572084 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1902c8d5-ba83-4a29-a765-8a45530b57fb tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:20.573263 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1902c8d5-ba83-4a29-a765-8a45530b57fb tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:20.573904 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-1902c8d5-ba83-4a29-a765-8a45530b57fb tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:20.716119 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-1902c8d5-ba83-4a29-a765-8a45530b57fb tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:20.724397 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-1902c8d5-ba83-4a29-a765-8a45530b57fb tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1554 microversion: 2.1 time: 0.166072 May 13 15:10:20.724967 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 567/1115] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:20 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:21.031033 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-24e723e3-248c-4f35-98e9-e09c8125b60d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:21.031950 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-24e723e3-248c-4f35-98e9-e09c8125b60d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:21.040592 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24e723e3-248c-4f35-98e9-e09c8125b60d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:21.041204 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24e723e3-248c-4f35-98e9-e09c8125b60d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:21.042213 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24e723e3-248c-4f35-98e9-e09c8125b60d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:21.042721 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-24e723e3-248c-4f35-98e9-e09c8125b60d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:21.184155 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-24e723e3-248c-4f35-98e9-e09c8125b60d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:21.191748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-24e723e3-248c-4f35-98e9-e09c8125b60d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1568 microversion: 2.1 time: 0.166578 May 13 15:10:21.192350 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 549/1116] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:21 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:21.746351 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-768fdfe5-cbc6-4ef7-8f06-d815571d329b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:21.747268 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-768fdfe5-cbc6-4ef7-8f06-d815571d329b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:21.754666 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-768fdfe5-cbc6-4ef7-8f06-d815571d329b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:21.755163 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-768fdfe5-cbc6-4ef7-8f06-d815571d329b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:21.756103 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-768fdfe5-cbc6-4ef7-8f06-d815571d329b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:21.756564 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-768fdfe5-cbc6-4ef7-8f06-d815571d329b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:21.897405 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-768fdfe5-cbc6-4ef7-8f06-d815571d329b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:21.907483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-768fdfe5-cbc6-4ef7-8f06-d815571d329b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1554 microversion: 2.1 time: 0.167495 May 13 15:10:21.908485 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 568/1117] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:21 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:22.214989 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b99cd237-0769-4510-a1a4-85d4a0f00ce0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:22.215693 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b99cd237-0769-4510-a1a4-85d4a0f00ce0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:22.222638 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b99cd237-0769-4510-a1a4-85d4a0f00ce0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:22.223109 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b99cd237-0769-4510-a1a4-85d4a0f00ce0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:22.223899 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b99cd237-0769-4510-a1a4-85d4a0f00ce0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:22.224382 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b99cd237-0769-4510-a1a4-85d4a0f00ce0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:22.374501 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b99cd237-0769-4510-a1a4-85d4a0f00ce0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:22.386280 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b99cd237-0769-4510-a1a4-85d4a0f00ce0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1568 microversion: 2.1 time: 0.178599 May 13 15:10:22.386954 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 550/1118] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:22 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:22.931573 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-67f0434a-9f19-40f9-be23-0e26b456a1de tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:22.932215 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-67f0434a-9f19-40f9-be23-0e26b456a1de tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:22.939356 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-67f0434a-9f19-40f9-be23-0e26b456a1de tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:22.939806 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-67f0434a-9f19-40f9-be23-0e26b456a1de tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:22.940619 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-67f0434a-9f19-40f9-be23-0e26b456a1de tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:22.941061 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-67f0434a-9f19-40f9-be23-0e26b456a1de tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:23.073362 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-67f0434a-9f19-40f9-be23-0e26b456a1de tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0e98de8d4724199b381482f91a06d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad2d2bbcfc0c42659c9150d3ba5012af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:23.081620 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-67f0434a-9f19-40f9-be23-0e26b456a1de tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 200 len: 1554 microversion: 2.1 time: 0.156504 May 13 15:10:23.082269 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 569/1119] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:22 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:23.412846 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-061c05f1-0523-4d8c-b78a-a6ddf1a339c2 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:23.415082 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-061c05f1-0523-4d8c-b78a-a6ddf1a339c2 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:23.422784 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-061c05f1-0523-4d8c-b78a-a6ddf1a339c2 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:23.423326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-061c05f1-0523-4d8c-b78a-a6ddf1a339c2 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:23.424672 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-061c05f1-0523-4d8c-b78a-a6ddf1a339c2 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:23.425188 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-061c05f1-0523-4d8c-b78a-a6ddf1a339c2 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:23.441810 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-f273f23b-e33d-4f29-a98b-af8253392b26 req-543dd6b6-47c9-4de8-b7eb-7d074cd210e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b824c80-f960-4b9c-be30-b484dec17b53", "name": "network-vif-deleted", "tag": "a46c2165-63f8-4ffe-a613-741dad61b95c"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:10:23.450522 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-f273f23b-e33d-4f29-a98b-af8253392b26 req-543dd6b6-47c9-4de8-b7eb-7d074cd210e2 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:23.450892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-f273f23b-e33d-4f29-a98b-af8253392b26 req-543dd6b6-47c9-4de8-b7eb-7d074cd210e2 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:23.463769 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-f273f23b-e33d-4f29-a98b-af8253392b26 req-543dd6b6-47c9-4de8-b7eb-7d074cd210e2 service nova] Creating event network-vif-deleted:a46c2165-63f8-4ffe-a613-741dad61b95c for instance 9b824c80-f960-4b9c-be30-b484dec17b53 on hv-cinder-83090 May 13 15:10:23.468953 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-f273f23b-e33d-4f29-a98b-af8253392b26 req-543dd6b6-47c9-4de8-b7eb-7d074cd210e2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030829 May 13 15:10:23.469587 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 570/1120] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:10:23.576231 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-061c05f1-0523-4d8c-b78a-a6ddf1a339c2 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:23.584185 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-061c05f1-0523-4d8c-b78a-a6ddf1a339c2 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1568 microversion: 2.1 time: 0.175785 May 13 15:10:23.585087 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 551/1121] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:23 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:24.104013 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-539793e9-0752-490d-8188-06d4f2f4ee5f tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:24.105008 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-539793e9-0752-490d-8188-06d4f2f4ee5f tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] [instance: 9b824c80-f960-4b9c-be30-b484dec17b53] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:24.112787 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-539793e9-0752-490d-8188-06d4f2f4ee5f tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:24.113256 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-539793e9-0752-490d-8188-06d4f2f4ee5f tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:24.114081 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-539793e9-0752-490d-8188-06d4f2f4ee5f tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:24.114520 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-539793e9-0752-490d-8188-06d4f2f4ee5f tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:24.129274 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-539793e9-0752-490d-8188-06d4f2f4ee5f tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] HTTP exception thrown: Instance 9b824c80-f960-4b9c-be30-b484dec17b53 could not be found. May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-539793e9-0752-490d-8188-06d4f2f4ee5f tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Request method failure captured: May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 HTTP/1.1 May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnQJBzR-sM2gxzAv2ApJ_wvwy95atbRm57vtYKOJ9EiJqWJOoCgvCFTWXeqnV6udoUXPDV_Ha9L1xK77TUjwPeEzfGysedZhNOG_5gQ4hCkRjmiYhGZXaJpN_8gFuqJwBQBloVpwXo4DoysuvjWtDzjtjm1gAiS_YEVhCub4bPVcmCE May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: ad2d2bbcfc0c42659c9150d3ba5012af May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-TestMinimumBasicScenario-1124200552 May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:10:24.130927 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:10:24.132790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ad2d2bbcfc0c42659c9150d3ba5012af", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ad2d2bbcfc0c42659c9150d3ba5012af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ad2d2bbcfc0c42659c9150d3ba5012af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ad2d2bbcfc0c42659c9150d3ba5012af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:10:24.132790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-TestMinimumBasicScenario-1124200552 May 13 15:10:24.132790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: ad2d2bbcfc0c42659c9150d3ba5012af May 13 15:10:24.132790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1124200552 May 13 15:10:24.132790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-TestMinimumBasicScenario-1124200552-project May 13 15:10:24.132790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:10:24.132790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:10:24.132790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: c0e98de8d4724199b381482f91a06d74 May 13 15:10:24.132790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-TestMinimumBasicScenario-1124200552-project May 13 15:10:24.132790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:10:24.132790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 9b824c80-f960-4b9c-be30-b484dec17b53 could not be found. May 13 15:10:24.132790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '9b824c80-f960-4b9c-be30-b484dec17b53'} May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b824c80-f960-4b9c-be30-b484dec17b53 could not be found. May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:10:24.134016 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b824c80-f960-4b9c-be30-b484dec17b53 could not be found. May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b824c80-f960-4b9c-be30-b484dec17b53 could not be found. May 13 15:10:24.135848 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:10:24.137744 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-539793e9-0752-490d-8188-06d4f2f4ee5f tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Returning 404 to user: Instance 9b824c80-f960-4b9c-be30-b484dec17b53 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:10:24.137744 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-539793e9-0752-490d-8188-06d4f2f4ee5f tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53" status: 404 len: 111 microversion: 2.1 time: 0.035627 May 13 15:10:24.137744 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 571/1122] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:24 2022] GET /compute/v2.1/servers/9b824c80-f960-4b9c-be30-b484dec17b53 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 15:10:24.142892 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-dda6ce81-0db5-4093-9423-42c2fa21479b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] Calling method '.version_select at 0x7fcf480ed5e0>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:24.165345 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-dda6ce81-0db5-4093-9423-42c2fa21479b tempest-TestMinimumBasicScenario-1124200552 tempest-TestMinimumBasicScenario-1124200552-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-802583060" status: 202 len: 0 microversion: 2.1 time: 0.026485 May 13 15:10:24.165932 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 552/1123] 10.222.0.99 () {58 vars in 1268 bytes} [Fri May 13 15:10:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-802583060 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:10:24.601386 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-11a428a6-9136-4c14-b59c-257a359aab48 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:24.602023 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-11a428a6-9136-4c14-b59c-257a359aab48 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:24.608537 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-11a428a6-9136-4c14-b59c-257a359aab48 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:24.608915 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-11a428a6-9136-4c14-b59c-257a359aab48 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:24.610031 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-11a428a6-9136-4c14-b59c-257a359aab48 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:24.610526 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-11a428a6-9136-4c14-b59c-257a359aab48 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:24.754430 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-11a428a6-9136-4c14-b59c-257a359aab48 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:24.762645 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-11a428a6-9136-4c14-b59c-257a359aab48 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1568 microversion: 2.1 time: 0.164834 May 13 15:10:24.763214 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 572/1124] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:24 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:25.783533 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-4bac5b16-c592-4aed-90fa-5fd2cdb6d99f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:25.784210 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-4bac5b16-c592-4aed-90fa-5fd2cdb6d99f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:25.791349 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4bac5b16-c592-4aed-90fa-5fd2cdb6d99f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:25.791803 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4bac5b16-c592-4aed-90fa-5fd2cdb6d99f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:25.793554 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4bac5b16-c592-4aed-90fa-5fd2cdb6d99f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:25.794012 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4bac5b16-c592-4aed-90fa-5fd2cdb6d99f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:26.041521 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-4bac5b16-c592-4aed-90fa-5fd2cdb6d99f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:26.050572 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-4bac5b16-c592-4aed-90fa-5fd2cdb6d99f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1568 microversion: 2.1 time: 0.271341 May 13 15:10:26.051171 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 553/1125] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:25 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:27.070302 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-00b25930-5206-4a90-916c-b4e59a0b5033 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:27.070994 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-00b25930-5206-4a90-916c-b4e59a0b5033 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:27.078156 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-00b25930-5206-4a90-916c-b4e59a0b5033 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:27.078669 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-00b25930-5206-4a90-916c-b4e59a0b5033 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:27.079892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-00b25930-5206-4a90-916c-b4e59a0b5033 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:27.080464 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-00b25930-5206-4a90-916c-b4e59a0b5033 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:27.301855 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-00b25930-5206-4a90-916c-b4e59a0b5033 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:27.309887 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-00b25930-5206-4a90-916c-b4e59a0b5033 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1568 microversion: 2.1 time: 0.243728 May 13 15:10:27.310434 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 573/1126] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:27 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:28.327227 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-ad6d84a6-4c33-4a65-b1a2-f37185a2033a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:28.328253 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-ad6d84a6-4c33-4a65-b1a2-f37185a2033a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:28.336938 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ad6d84a6-4c33-4a65-b1a2-f37185a2033a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:28.337380 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ad6d84a6-4c33-4a65-b1a2-f37185a2033a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:28.338177 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ad6d84a6-4c33-4a65-b1a2-f37185a2033a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:28.338598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-ad6d84a6-4c33-4a65-b1a2-f37185a2033a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:28.475460 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-ad6d84a6-4c33-4a65-b1a2-f37185a2033a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:28.484950 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-ad6d84a6-4c33-4a65-b1a2-f37185a2033a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1568 microversion: 2.1 time: 0.161940 May 13 15:10:28.485592 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 554/1127] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:28 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:29.502497 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-cb6afce7-667f-48c5-9931-2e82a139911f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:29.503135 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-cb6afce7-667f-48c5-9931-2e82a139911f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:29.509344 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cb6afce7-667f-48c5-9931-2e82a139911f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:29.509796 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cb6afce7-667f-48c5-9931-2e82a139911f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:29.510579 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cb6afce7-667f-48c5-9931-2e82a139911f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:29.511103 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-cb6afce7-667f-48c5-9931-2e82a139911f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:29.649980 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-cb6afce7-667f-48c5-9931-2e82a139911f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:29.658111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-cb6afce7-667f-48c5-9931-2e82a139911f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1568 microversion: 2.1 time: 0.159430 May 13 15:10:29.658694 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 574/1128] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:29 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:30.676921 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-d49dcaf3-0760-47a6-bd3a-f581a0f9a069 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:30.677931 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-d49dcaf3-0760-47a6-bd3a-f581a0f9a069 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:30.685928 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d49dcaf3-0760-47a6-bd3a-f581a0f9a069 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:30.686397 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d49dcaf3-0760-47a6-bd3a-f581a0f9a069 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:30.687291 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d49dcaf3-0760-47a6-bd3a-f581a0f9a069 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:30.688404 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d49dcaf3-0760-47a6-bd3a-f581a0f9a069 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:30.837335 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-d49dcaf3-0760-47a6-bd3a-f581a0f9a069 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:30.845994 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-d49dcaf3-0760-47a6-bd3a-f581a0f9a069 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1568 microversion: 2.1 time: 0.173041 May 13 15:10:30.846670 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 555/1129] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:30 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:31.863931 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-fddc2b29-f89a-4596-b9f4-6352082c7513 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:31.864540 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-fddc2b29-f89a-4596-b9f4-6352082c7513 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:31.870899 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fddc2b29-f89a-4596-b9f4-6352082c7513 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:31.871349 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fddc2b29-f89a-4596-b9f4-6352082c7513 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:31.872141 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fddc2b29-f89a-4596-b9f4-6352082c7513 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:31.872575 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-fddc2b29-f89a-4596-b9f4-6352082c7513 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:32.005035 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-fddc2b29-f89a-4596-b9f4-6352082c7513 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:32.013422 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-fddc2b29-f89a-4596-b9f4-6352082c7513 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1509 microversion: 2.1 time: 0.153585 May 13 15:10:32.014153 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 575/1130] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:31 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:32.030781 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c92f1072-f66b-43a3-b1e8-0de9006abd88 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:10:32.031358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c92f1072-f66b-43a3-b1e8-0de9006abd88 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:32.038175 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c92f1072-f66b-43a3-b1e8-0de9006abd88 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:32.038623 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c92f1072-f66b-43a3-b1e8-0de9006abd88 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:32.039404 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c92f1072-f66b-43a3-b1e8-0de9006abd88 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:32.039840 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c92f1072-f66b-43a3-b1e8-0de9006abd88 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:32.131239 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c92f1072-f66b-43a3-b1e8-0de9006abd88 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "POST /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216/action" status: 202 len: 0 microversion: 2.1 time: 0.104733 May 13 15:10:32.132278 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 556/1131] 10.222.0.99 () {60 vars in 1277 bytes} [Fri May 13 15:10:32 2022] POST /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 15:10:32.140898 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9b92b446-0342-436b-9cc6-72fd8d472f4c tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:32.141665 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9b92b446-0342-436b-9cc6-72fd8d472f4c tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:32.149008 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9b92b446-0342-436b-9cc6-72fd8d472f4c tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:32.149453 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9b92b446-0342-436b-9cc6-72fd8d472f4c tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:32.150232 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9b92b446-0342-436b-9cc6-72fd8d472f4c tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:32.150881 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9b92b446-0342-436b-9cc6-72fd8d472f4c tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:32.301190 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9b92b446-0342-436b-9cc6-72fd8d472f4c tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:32.309973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9b92b446-0342-436b-9cc6-72fd8d472f4c tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1517 microversion: 2.1 time: 0.173551 May 13 15:10:32.310730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 576/1132] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:32 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:33.070036 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-97f3fa28-9e76-4dca-a3d2-1a403db4ce1d req-aa6af116-8b01-4e49-b413-3b54ad3316ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895f9604-efa8-451b-9d41-b529fc177216", "name": "network-vif-unplugged", "status": "completed", "tag": "b172f3f7-c5de-42d8-bc4e-ed1a26ad41f0"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:10:33.082275 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-97f3fa28-9e76-4dca-a3d2-1a403db4ce1d req-aa6af116-8b01-4e49-b413-3b54ad3316ce service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:33.082959 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-97f3fa28-9e76-4dca-a3d2-1a403db4ce1d req-aa6af116-8b01-4e49-b413-3b54ad3316ce service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:33.097154 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.compute.server_external_events [req-97f3fa28-9e76-4dca-a3d2-1a403db4ce1d req-aa6af116-8b01-4e49-b413-3b54ad3316ce service nova] Unable to find a host for instance 895f9604-efa8-451b-9d41-b529fc177216. Dropping event network-vif-unplugged {{(pid=117296) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 13 15:10:33.098653 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-97f3fa28-9e76-4dca-a3d2-1a403db4ce1d req-aa6af116-8b01-4e49-b413-3b54ad3316ce service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033100 May 13 15:10:33.099384 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 557/1133] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 13 15:10:33.332209 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-6ca89ff6-2f6a-4064-8ba6-b1c904972302 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:33.333233 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-6ca89ff6-2f6a-4064-8ba6-b1c904972302 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:33.345279 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6ca89ff6-2f6a-4064-8ba6-b1c904972302 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:33.346078 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6ca89ff6-2f6a-4064-8ba6-b1c904972302 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:33.347370 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6ca89ff6-2f6a-4064-8ba6-b1c904972302 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:33.348148 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6ca89ff6-2f6a-4064-8ba6-b1c904972302 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:33.489757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-6ca89ff6-2f6a-4064-8ba6-b1c904972302 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:33.497157 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-6ca89ff6-2f6a-4064-8ba6-b1c904972302 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1517 microversion: 2.1 time: 0.171484 May 13 15:10:33.497723 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 577/1134] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:33 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:34.516270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-5631c968-ce80-4f95-b0cd-76b2bc4b45b0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:34.517040 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-5631c968-ce80-4f95-b0cd-76b2bc4b45b0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:34.525210 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5631c968-ce80-4f95-b0cd-76b2bc4b45b0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:34.525747 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5631c968-ce80-4f95-b0cd-76b2bc4b45b0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:34.526729 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5631c968-ce80-4f95-b0cd-76b2bc4b45b0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:34.527310 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-5631c968-ce80-4f95-b0cd-76b2bc4b45b0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:34.667209 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-5631c968-ce80-4f95-b0cd-76b2bc4b45b0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:34.675497 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-5631c968-ce80-4f95-b0cd-76b2bc4b45b0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1517 microversion: 2.1 time: 0.164051 May 13 15:10:34.676152 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 558/1135] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:34 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:35.703264 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e38c941a-6b8c-4a43-88b9-f1a136c1d1ae tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:35.704148 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e38c941a-6b8c-4a43-88b9-f1a136c1d1ae tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:35.715380 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e38c941a-6b8c-4a43-88b9-f1a136c1d1ae tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:35.715823 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e38c941a-6b8c-4a43-88b9-f1a136c1d1ae tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:35.716634 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e38c941a-6b8c-4a43-88b9-f1a136c1d1ae tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:35.717068 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e38c941a-6b8c-4a43-88b9-f1a136c1d1ae tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:35.867920 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e38c941a-6b8c-4a43-88b9-f1a136c1d1ae tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:35.878684 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e38c941a-6b8c-4a43-88b9-f1a136c1d1ae tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1517 microversion: 2.1 time: 0.182327 May 13 15:10:35.879234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 578/1136] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:35 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:36.901341 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b9b684de-a0ea-47b6-8ab2-257b2442a9d7 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:36.902357 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b9b684de-a0ea-47b6-8ab2-257b2442a9d7 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:36.913839 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b9b684de-a0ea-47b6-8ab2-257b2442a9d7 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:36.914584 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b9b684de-a0ea-47b6-8ab2-257b2442a9d7 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:36.915911 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b9b684de-a0ea-47b6-8ab2-257b2442a9d7 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:36.916644 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b9b684de-a0ea-47b6-8ab2-257b2442a9d7 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:37.062642 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b9b684de-a0ea-47b6-8ab2-257b2442a9d7 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:37.073577 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b9b684de-a0ea-47b6-8ab2-257b2442a9d7 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1517 microversion: 2.1 time: 0.178976 May 13 15:10:37.074125 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 559/1137] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:36 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:38.093468 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3107ea18-d1bb-43db-992a-4c916a47ac91 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:38.094040 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3107ea18-d1bb-43db-992a-4c916a47ac91 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:38.100778 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3107ea18-d1bb-43db-992a-4c916a47ac91 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:38.101220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3107ea18-d1bb-43db-992a-4c916a47ac91 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:38.101995 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3107ea18-d1bb-43db-992a-4c916a47ac91 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:38.102417 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3107ea18-d1bb-43db-992a-4c916a47ac91 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:38.244632 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3107ea18-d1bb-43db-992a-4c916a47ac91 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:38.253370 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3107ea18-d1bb-43db-992a-4c916a47ac91 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1575 microversion: 2.1 time: 0.163955 May 13 15:10:38.253923 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 579/1138] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:38 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:39.271410 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-12fa037f-f14f-469f-96f7-98d2108adb1f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:39.272173 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-12fa037f-f14f-469f-96f7-98d2108adb1f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:39.279283 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-12fa037f-f14f-469f-96f7-98d2108adb1f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:39.279903 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-12fa037f-f14f-469f-96f7-98d2108adb1f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:39.280522 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-12fa037f-f14f-469f-96f7-98d2108adb1f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:39.280948 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-12fa037f-f14f-469f-96f7-98d2108adb1f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:39.435311 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-12fa037f-f14f-469f-96f7-98d2108adb1f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:39.443834 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-12fa037f-f14f-469f-96f7-98d2108adb1f tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1575 microversion: 2.1 time: 0.176507 May 13 15:10:39.444439 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 560/1139] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:39 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:40.462149 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-b47ea91f-cfd6-46c0-9201-767ef2bf71b6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:40.462839 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-b47ea91f-cfd6-46c0-9201-767ef2bf71b6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:40.469973 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b47ea91f-cfd6-46c0-9201-767ef2bf71b6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:40.470426 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b47ea91f-cfd6-46c0-9201-767ef2bf71b6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:40.471218 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b47ea91f-cfd6-46c0-9201-767ef2bf71b6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:40.471629 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b47ea91f-cfd6-46c0-9201-767ef2bf71b6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:40.602121 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b47ea91f-cfd6-46c0-9201-767ef2bf71b6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:40.609719 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-b47ea91f-cfd6-46c0-9201-767ef2bf71b6 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1575 microversion: 2.1 time: 0.152122 May 13 15:10:40.610287 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 580/1140] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:40 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:41.627386 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f92d06e8-5957-417c-935b-1f8f3a609c8a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:41.628063 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f92d06e8-5957-417c-935b-1f8f3a609c8a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:41.635580 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f92d06e8-5957-417c-935b-1f8f3a609c8a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:41.636077 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f92d06e8-5957-417c-935b-1f8f3a609c8a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:41.636851 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f92d06e8-5957-417c-935b-1f8f3a609c8a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:41.637282 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f92d06e8-5957-417c-935b-1f8f3a609c8a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:41.783028 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f92d06e8-5957-417c-935b-1f8f3a609c8a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:41.792654 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f92d06e8-5957-417c-935b-1f8f3a609c8a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1575 microversion: 2.1 time: 0.169602 May 13 15:10:41.793231 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 561/1141] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:41 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:42.815190 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9f0c9bae-4a83-45cb-bb17-088480dce9e0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:42.816369 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9f0c9bae-4a83-45cb-bb17-088480dce9e0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:42.826944 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9f0c9bae-4a83-45cb-bb17-088480dce9e0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:42.827697 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9f0c9bae-4a83-45cb-bb17-088480dce9e0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:42.829034 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9f0c9bae-4a83-45cb-bb17-088480dce9e0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:42.829767 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9f0c9bae-4a83-45cb-bb17-088480dce9e0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:42.966245 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9f0c9bae-4a83-45cb-bb17-088480dce9e0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:42.974342 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9f0c9bae-4a83-45cb-bb17-088480dce9e0 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1575 microversion: 2.1 time: 0.166004 May 13 15:10:42.974882 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 581/1142] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:42 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:43.995617 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-2e7ed53c-6f81-4bcc-aa0b-250ec275e041 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:43.996628 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-2e7ed53c-6f81-4bcc-aa0b-250ec275e041 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:44.007267 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2e7ed53c-6f81-4bcc-aa0b-250ec275e041 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:44.007715 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2e7ed53c-6f81-4bcc-aa0b-250ec275e041 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:44.008552 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2e7ed53c-6f81-4bcc-aa0b-250ec275e041 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:44.008979 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-2e7ed53c-6f81-4bcc-aa0b-250ec275e041 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:44.150048 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-2e7ed53c-6f81-4bcc-aa0b-250ec275e041 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:44.157471 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-2e7ed53c-6f81-4bcc-aa0b-250ec275e041 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1575 microversion: 2.1 time: 0.168306 May 13 15:10:44.158042 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 562/1143] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:43 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:45.179018 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-3639804c-7c55-49a7-9fc8-b1b5c6e3da41 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:45.180068 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-3639804c-7c55-49a7-9fc8-b1b5c6e3da41 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:45.190606 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3639804c-7c55-49a7-9fc8-b1b5c6e3da41 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:45.191321 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3639804c-7c55-49a7-9fc8-b1b5c6e3da41 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:45.192783 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3639804c-7c55-49a7-9fc8-b1b5c6e3da41 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:45.193500 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-3639804c-7c55-49a7-9fc8-b1b5c6e3da41 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:45.335836 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-3639804c-7c55-49a7-9fc8-b1b5c6e3da41 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:45.347712 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-3639804c-7c55-49a7-9fc8-b1b5c6e3da41 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1575 microversion: 2.1 time: 0.175156 May 13 15:10:45.348564 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 582/1144] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:45 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:46.369110 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-aeaa73a2-f3ee-44ba-b593-b2035dad3636 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:46.369857 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-aeaa73a2-f3ee-44ba-b593-b2035dad3636 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:46.378017 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-aeaa73a2-f3ee-44ba-b593-b2035dad3636 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:46.378577 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-aeaa73a2-f3ee-44ba-b593-b2035dad3636 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:46.379545 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-aeaa73a2-f3ee-44ba-b593-b2035dad3636 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:46.380134 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-aeaa73a2-f3ee-44ba-b593-b2035dad3636 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:46.525418 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-aeaa73a2-f3ee-44ba-b593-b2035dad3636 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:46.533356 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-aeaa73a2-f3ee-44ba-b593-b2035dad3636 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1575 microversion: 2.1 time: 0.170175 May 13 15:10:46.533944 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 563/1145] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:46 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:47.550986 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-b09a0930-4308-4887-8363-2218daf8a4cc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:47.551489 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-b09a0930-4308-4887-8363-2218daf8a4cc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:47.558418 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b09a0930-4308-4887-8363-2218daf8a4cc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:47.558863 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b09a0930-4308-4887-8363-2218daf8a4cc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:47.559649 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b09a0930-4308-4887-8363-2218daf8a4cc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:47.560111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-b09a0930-4308-4887-8363-2218daf8a4cc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:47.700663 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-b09a0930-4308-4887-8363-2218daf8a4cc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:47.709504 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-b09a0930-4308-4887-8363-2218daf8a4cc tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1575 microversion: 2.1 time: 0.162515 May 13 15:10:47.710311 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 583/1146] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:47 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:48.728121 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-02930e67-8cdd-4c42-a309-f120d0821261 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:48.729404 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-02930e67-8cdd-4c42-a309-f120d0821261 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:48.741777 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-02930e67-8cdd-4c42-a309-f120d0821261 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:48.742456 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-02930e67-8cdd-4c42-a309-f120d0821261 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:48.743706 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-02930e67-8cdd-4c42-a309-f120d0821261 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:48.744338 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-02930e67-8cdd-4c42-a309-f120d0821261 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:48.894112 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-02930e67-8cdd-4c42-a309-f120d0821261 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:48.903758 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-02930e67-8cdd-4c42-a309-f120d0821261 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1575 microversion: 2.1 time: 0.180027 May 13 15:10:48.904504 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 564/1147] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:48 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:49.212728 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-15edf03d-708b-461a-a2a2-7108c4d20949 req-48722db6-bc28-40e3-a218-21407a207d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895f9604-efa8-451b-9d41-b529fc177216", "name": "network-vif-plugged", "status": "completed", "tag": "b172f3f7-c5de-42d8-bc4e-ed1a26ad41f0"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:10:49.221590 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-15edf03d-708b-461a-a2a2-7108c4d20949 req-48722db6-bc28-40e3-a218-21407a207d68 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:49.222004 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-15edf03d-708b-461a-a2a2-7108c4d20949 req-48722db6-bc28-40e3-a218-21407a207d68 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:49.233661 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-15edf03d-708b-461a-a2a2-7108c4d20949 req-48722db6-bc28-40e3-a218-21407a207d68 service nova] Creating event network-vif-plugged:b172f3f7-c5de-42d8-bc4e-ed1a26ad41f0 for instance 895f9604-efa8-451b-9d41-b529fc177216 on hv-cinder-83090 May 13 15:10:49.238846 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-15edf03d-708b-461a-a2a2-7108c4d20949 req-48722db6-bc28-40e3-a218-21407a207d68 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030611 May 13 15:10:49.239454 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 584/1148] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:10:49.921593 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-16000454-6694-42cd-a66e-ee193344b1e3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:49.922226 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-16000454-6694-42cd-a66e-ee193344b1e3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:49.928721 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-16000454-6694-42cd-a66e-ee193344b1e3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:49.929168 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-16000454-6694-42cd-a66e-ee193344b1e3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:49.929919 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-16000454-6694-42cd-a66e-ee193344b1e3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:49.930469 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-16000454-6694-42cd-a66e-ee193344b1e3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:50.072010 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-16000454-6694-42cd-a66e-ee193344b1e3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:50.079891 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-16000454-6694-42cd-a66e-ee193344b1e3 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1575 microversion: 2.1 time: 0.162216 May 13 15:10:50.080487 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 565/1149] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:49 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:10:51.101152 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-9f45620e-571e-4fc2-9df3-2edc644f10f1 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:10:51.102019 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-9f45620e-571e-4fc2-9df3-2edc644f10f1 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:10:51.108580 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9f45620e-571e-4fc2-9df3-2edc644f10f1 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:51.109025 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9f45620e-571e-4fc2-9df3-2edc644f10f1 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:51.109797 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9f45620e-571e-4fc2-9df3-2edc644f10f1 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:10:51.110228 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-9f45620e-571e-4fc2-9df3-2edc644f10f1 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:10:51.264931 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-9f45620e-571e-4fc2-9df3-2edc644f10f1 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:10:51.272867 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-9f45620e-571e-4fc2-9df3-2edc644f10f1 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1562 microversion: 2.1 time: 0.176657 May 13 15:10:51.273606 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 585/1150] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:10:51 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1562 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:17.823358 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9362ef86-efe9-4da3-8ac2-73e3ad3bc1c2] AMQP server on 10.222.0.99:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 13 15:12:17.827044 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b33834ed-acf8-4b9d-a671-255ab5e8ea74 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-979180664", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-472517037", "security_groups": [{"name": "tempest-secgroup-smoke-2127112240"}], "block_device_mapping_v2": [{"uuid": "81b23e50-262f-444e-a9c7-c5626c847f6b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7ff3f59b-50c6-43ba-999e-35f70470c4f1"}]}} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:12:17.957557 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.network.neutron [None req-b33834ed-acf8-4b9d-a671-255ab5e8ea74 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] validate_networks() for [('7ff3f59b-50c6-43ba-999e-35f70470c4f1', None, None, None, None, None)] {{(pid=117296) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 15:12:18.651837 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-b33834ed-acf8-4b9d-a671-255ab5e8ea74 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Flavor limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 15:12:18.652477 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-b33834ed-acf8-4b9d-a671-255ab5e8ea74 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Image limits 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 15:12:18.653212 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-b33834ed-acf8-4b9d-a671-255ab5e8ea74 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Flavor pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 15:12:18.653783 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-b33834ed-acf8-4b9d-a671-255ab5e8ea74 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Image pref 0:0:0 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 15:12:18.654392 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.virt.hardware [None req-b33834ed-acf8-4b9d-a671-255ab5e8ea74 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117296) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 15:12:18.666500 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b33834ed-acf8-4b9d-a671-255ab5e8ea74 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:18.667152 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b33834ed-acf8-4b9d-a671-255ab5e8ea74 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:18.668424 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b33834ed-acf8-4b9d-a671-255ab5e8ea74 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:18.669040 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b33834ed-acf8-4b9d-a671-255ab5e8ea74 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:18.690020 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-b33834ed-acf8-4b9d-a671-255ab5e8ea74 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Getting quotas for project 76d2cdfd3aac43e3bb71ae6dda71da82. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 15:12:18.694400 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.quota [None req-b33834ed-acf8-4b9d-a671-255ab5e8ea74 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Getting quotas for user f713f767dbf14d10b9100ea52d093d6b and project 76d2cdfd3aac43e3bb71ae6dda71da82. Resources: {'instances', 'ram', 'cores'} {{(pid=117296) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 15:12:18.754169 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b33834ed-acf8-4b9d-a671-255ab5e8ea74 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Going to run 1 instances... {{(pid=117296) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 15:12:18.756567 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b33834ed-acf8-4b9d-a671-255ab5e8ea74 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='81b23e50-262f-444e-a9c7-c5626c847f6b',volume_size=None,volume_type=None)] {{(pid=117296) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 15:12:18.836265 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO oslo.messaging._drivers.impl_rabbit [-] [9362ef86-efe9-4da3-8ac2-73e3ad3bc1c2] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 35894. May 13 15:12:18.909099 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b33834ed-acf8-4b9d-a671-255ab5e8ea74 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.087903 May 13 15:12:18.909713 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 566/1151] 10.222.0.99 () {60 vars in 1146 bytes} [Fri May 13 15:12:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 15:12:18.921126 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-d22c9ecf-0224-4e54-bad2-9c1f7a749eae tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:18.921678 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-d22c9ecf-0224-4e54-bad2-9c1f7a749eae tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:18.974087 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-d22c9ecf-0224-4e54-bad2-9c1f7a749eae tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:18.981018 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-d22c9ecf-0224-4e54-bad2-9c1f7a749eae tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1093 microversion: 2.1 time: 0.064977 May 13 15:12:18.981585 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 586/1152] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:18 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:19.998535 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-cb6f20d6-526f-41ed-869b-5a0dd94a373e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:19.999108 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-cb6f20d6-526f-41ed-869b-5a0dd94a373e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:20.051389 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-cb6f20d6-526f-41ed-869b-5a0dd94a373e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:20.058575 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-cb6f20d6-526f-41ed-869b-5a0dd94a373e tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1093 microversion: 2.1 time: 0.064270 May 13 15:12:20.059093 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 567/1153] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:19 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:21.075024 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-38f5c800-0e35-4a6e-b2a6-622c71c4f8b7 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:21.075703 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-38f5c800-0e35-4a6e-b2a6-622c71c4f8b7 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:21.128966 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-38f5c800-0e35-4a6e-b2a6-622c71c4f8b7 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:21.137488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-38f5c800-0e35-4a6e-b2a6-622c71c4f8b7 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1093 microversion: 2.1 time: 0.066469 May 13 15:12:21.138104 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 587/1154] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:21 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:22.157662 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-44a3625a-d24a-4168-a689-fe010624b73b tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:22.158605 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-44a3625a-d24a-4168-a689-fe010624b73b tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:22.221281 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-44a3625a-d24a-4168-a689-fe010624b73b tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:22.230428 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-44a3625a-d24a-4168-a689-fe010624b73b tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1093 microversion: 2.1 time: 0.079182 May 13 15:12:22.239732 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 568/1155] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:22 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1093 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:23.251515 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-63a3ff88-c347-4cea-8b26-cd862be67db0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:23.252567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-63a3ff88-c347-4cea-8b26-cd862be67db0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:23.263487 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-63a3ff88-c347-4cea-8b26-cd862be67db0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:23.264315 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-63a3ff88-c347-4cea-8b26-cd862be67db0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:23.265600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-63a3ff88-c347-4cea-8b26-cd862be67db0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:23.266438 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-63a3ff88-c347-4cea-8b26-cd862be67db0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:23.329710 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-63a3ff88-c347-4cea-8b26-cd862be67db0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:23.337744 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-63a3ff88-c347-4cea-8b26-cd862be67db0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1143 microversion: 2.1 time: 0.092920 May 13 15:12:23.338306 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 588/1156] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:23 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1143 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:24.355279 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-1f12c88a-e1c7-47c3-9ccc-42112afbcf18 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:24.355931 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-1f12c88a-e1c7-47c3-9ccc-42112afbcf18 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:24.362579 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f12c88a-e1c7-47c3-9ccc-42112afbcf18 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:24.363023 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f12c88a-e1c7-47c3-9ccc-42112afbcf18 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:24.363814 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f12c88a-e1c7-47c3-9ccc-42112afbcf18 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:24.364290 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-1f12c88a-e1c7-47c3-9ccc-42112afbcf18 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:24.430799 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-1f12c88a-e1c7-47c3-9ccc-42112afbcf18 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:24.438575 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-1f12c88a-e1c7-47c3-9ccc-42112afbcf18 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1209 microversion: 2.1 time: 0.087735 May 13 15:12:24.439174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 569/1157] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:24 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:25.456800 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-5dc72d9c-8553-474f-a84e-d12f774a81b3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:25.457397 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-5dc72d9c-8553-474f-a84e-d12f774a81b3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:25.464335 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5dc72d9c-8553-474f-a84e-d12f774a81b3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:25.464788 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5dc72d9c-8553-474f-a84e-d12f774a81b3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:25.465581 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5dc72d9c-8553-474f-a84e-d12f774a81b3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:25.466019 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-5dc72d9c-8553-474f-a84e-d12f774a81b3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:25.588342 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-8d81c1b0-2912-4c56-8c6f-30dfa727ebd7 req-99eafd9c-f468-41b3-9e3a-df0601db49d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0", "tag": "611441d5-ddd9-4003-afb3-089dbc1495dc"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:12:25.600276 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-8d81c1b0-2912-4c56-8c6f-30dfa727ebd7 req-99eafd9c-f468-41b3-9e3a-df0601db49d0 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:25.601230 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-8d81c1b0-2912-4c56-8c6f-30dfa727ebd7 req-99eafd9c-f468-41b3-9e3a-df0601db49d0 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:25.606095 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-5dc72d9c-8553-474f-a84e-d12f774a81b3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:25.615918 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-8d81c1b0-2912-4c56-8c6f-30dfa727ebd7 req-99eafd9c-f468-41b3-9e3a-df0601db49d0 service nova] Creating event network-changed:611441d5-ddd9-4003-afb3-089dbc1495dc for instance 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 on hv-cinder-83090 May 13 15:12:25.617813 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-5dc72d9c-8553-474f-a84e-d12f774a81b3 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1265 microversion: 2.1 time: 0.164323 May 13 15:12:25.618074 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 589/1158] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:25 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:25.630758 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-8d81c1b0-2912-4c56-8c6f-30dfa727ebd7 req-99eafd9c-f468-41b3-9e3a-df0601db49d0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046739 May 13 15:12:25.631745 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 570/1159] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:12:26.635369 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-73a10f73-c3ef-44b2-88b3-46eadfc74361 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:26.636003 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-73a10f73-c3ef-44b2-88b3-46eadfc74361 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:26.642992 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-73a10f73-c3ef-44b2-88b3-46eadfc74361 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:26.643439 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-73a10f73-c3ef-44b2-88b3-46eadfc74361 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:26.644245 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-73a10f73-c3ef-44b2-88b3-46eadfc74361 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:26.644679 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-73a10f73-c3ef-44b2-88b3-46eadfc74361 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:26.784853 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-73a10f73-c3ef-44b2-88b3-46eadfc74361 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:26.793434 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-73a10f73-c3ef-44b2-88b3-46eadfc74361 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1265 microversion: 2.1 time: 0.162501 May 13 15:12:26.794045 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 590/1160] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:26 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:27.811050 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b8dd616a-06a9-44db-9530-8db906c586ee tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:27.811882 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b8dd616a-06a9-44db-9530-8db906c586ee tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:27.818167 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b8dd616a-06a9-44db-9530-8db906c586ee tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:27.818615 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b8dd616a-06a9-44db-9530-8db906c586ee tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:27.819440 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b8dd616a-06a9-44db-9530-8db906c586ee tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:27.819889 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b8dd616a-06a9-44db-9530-8db906c586ee tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:27.957704 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b8dd616a-06a9-44db-9530-8db906c586ee tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:27.966388 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b8dd616a-06a9-44db-9530-8db906c586ee tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1265 microversion: 2.1 time: 0.160111 May 13 15:12:27.966972 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 571/1161] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:27 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:28.289399 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-10fa5c4d-a954-4822-988e-518e7c54b15d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:28.290278 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-10fa5c4d-a954-4822-988e-518e7c54b15d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:28.291459 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-51b47216-a73d-4ae0-b069-e5b9e3e51388 req-cba033f7-3fac-4bd4-a178-aa8ef19763e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "895f9604-efa8-451b-9d41-b529fc177216", "tag": "b172f3f7-c5de-42d8-bc4e-ed1a26ad41f0"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:12:28.296985 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-10fa5c4d-a954-4822-988e-518e7c54b15d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:28.297574 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-10fa5c4d-a954-4822-988e-518e7c54b15d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:28.298632 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-10fa5c4d-a954-4822-988e-518e7c54b15d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:28.299168 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-10fa5c4d-a954-4822-988e-518e7c54b15d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:28.299499 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-51b47216-a73d-4ae0-b069-e5b9e3e51388 req-cba033f7-3fac-4bd4-a178-aa8ef19763e2 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:28.299973 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-51b47216-a73d-4ae0-b069-e5b9e3e51388 req-cba033f7-3fac-4bd4-a178-aa8ef19763e2 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:28.316441 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-51b47216-a73d-4ae0-b069-e5b9e3e51388 req-cba033f7-3fac-4bd4-a178-aa8ef19763e2 service nova] Creating event network-changed:b172f3f7-c5de-42d8-bc4e-ed1a26ad41f0 for instance 895f9604-efa8-451b-9d41-b529fc177216 on hv-cinder-83090 May 13 15:12:28.321857 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-51b47216-a73d-4ae0-b069-e5b9e3e51388 req-cba033f7-3fac-4bd4-a178-aa8ef19763e2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034810 May 13 15:12:28.322466 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 572/1162] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:12:28.328666 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-10fa5c4d-a954-4822-988e-518e7c54b15d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Going to try to terminate instance {{(pid=117295) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 15:12:28.420592 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-10fa5c4d-a954-4822-988e-518e7c54b15d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "DELETE /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 204 len: 0 microversion: 2.1 time: 0.135249 May 13 15:12:28.421291 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 591/1163] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:12:28 2022] DELETE /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 15:12:28.432966 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-aa8bb972-a906-4bfa-974e-e12d53e94d9a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:28.433920 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-aa8bb972-a906-4bfa-974e-e12d53e94d9a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:28.440727 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-aa8bb972-a906-4bfa-974e-e12d53e94d9a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:28.441429 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-aa8bb972-a906-4bfa-974e-e12d53e94d9a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:28.442214 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-aa8bb972-a906-4bfa-974e-e12d53e94d9a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:28.442651 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-aa8bb972-a906-4bfa-974e-e12d53e94d9a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:28.592133 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-aa8bb972-a906-4bfa-974e-e12d53e94d9a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:28.599889 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-aa8bb972-a906-4bfa-974e-e12d53e94d9a tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1568 microversion: 2.1 time: 0.171889 May 13 15:12:28.600458 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 573/1164] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:28 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:28.680335 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 15:12:28.680594 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Fri May 13 15:12:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 15:12:28.983592 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-ad4d8b73-1774-4f02-bc11-6a06bc9d4b24 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:28.984304 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-ad4d8b73-1774-4f02-bc11-6a06bc9d4b24 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:28.990744 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ad4d8b73-1774-4f02-bc11-6a06bc9d4b24 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:28.991187 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ad4d8b73-1774-4f02-bc11-6a06bc9d4b24 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:28.991958 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ad4d8b73-1774-4f02-bc11-6a06bc9d4b24 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:28.992427 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-ad4d8b73-1774-4f02-bc11-6a06bc9d4b24 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:29.130048 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-ad4d8b73-1774-4f02-bc11-6a06bc9d4b24 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:29.138378 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-ad4d8b73-1774-4f02-bc11-6a06bc9d4b24 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1265 microversion: 2.1 time: 0.159034 May 13 15:12:29.138986 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 592/1165] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:28 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:29.618361 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-58d0aaa2-1513-416a-9cd6-8ac174464c86 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:29.618995 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-58d0aaa2-1513-416a-9cd6-8ac174464c86 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:29.625840 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-58d0aaa2-1513-416a-9cd6-8ac174464c86 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:29.626290 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-58d0aaa2-1513-416a-9cd6-8ac174464c86 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:29.627425 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-58d0aaa2-1513-416a-9cd6-8ac174464c86 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:29.628075 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-58d0aaa2-1513-416a-9cd6-8ac174464c86 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:29.768372 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-58d0aaa2-1513-416a-9cd6-8ac174464c86 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:29.776421 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-58d0aaa2-1513-416a-9cd6-8ac174464c86 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1568 microversion: 2.1 time: 0.162086 May 13 15:12:29.776996 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 574/1166] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:29 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:30.154888 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-2dfe970d-bdcd-4614-8991-49502bf14087 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:30.155475 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-2dfe970d-bdcd-4614-8991-49502bf14087 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:30.162283 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2dfe970d-bdcd-4614-8991-49502bf14087 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:30.162731 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2dfe970d-bdcd-4614-8991-49502bf14087 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:30.163490 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2dfe970d-bdcd-4614-8991-49502bf14087 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:30.163981 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-2dfe970d-bdcd-4614-8991-49502bf14087 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:30.317988 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-2dfe970d-bdcd-4614-8991-49502bf14087 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:30.326329 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-2dfe970d-bdcd-4614-8991-49502bf14087 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1265 microversion: 2.1 time: 0.175393 May 13 15:12:30.326874 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 593/1167] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:30 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:30.795010 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-91afe110-7225-4559-81de-3122269f6c7d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:30.795584 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-91afe110-7225-4559-81de-3122269f6c7d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:30.802145 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-91afe110-7225-4559-81de-3122269f6c7d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:30.802631 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-91afe110-7225-4559-81de-3122269f6c7d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:30.803398 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-91afe110-7225-4559-81de-3122269f6c7d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:30.803833 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-91afe110-7225-4559-81de-3122269f6c7d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:30.870099 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-91afe110-7225-4559-81de-3122269f6c7d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb4364f9eb6426581b983a436671b2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43258e7d75e41f3b8763db3122c86b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:30.878952 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-91afe110-7225-4559-81de-3122269f6c7d tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 200 len: 1382 microversion: 2.1 time: 0.087896 May 13 15:12:30.879522 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 575/1168] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:30 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 1382 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:30.915048 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-4f31a204-4868-496e-a448-501dd9329a72 req-ebad84dc-5b7e-4482-9f54-b0f3dc75061f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895f9604-efa8-451b-9d41-b529fc177216", "name": "network-vif-deleted", "tag": "b172f3f7-c5de-42d8-bc4e-ed1a26ad41f0"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:12:30.924716 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-4f31a204-4868-496e-a448-501dd9329a72 req-ebad84dc-5b7e-4482-9f54-b0f3dc75061f service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:30.925367 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-4f31a204-4868-496e-a448-501dd9329a72 req-ebad84dc-5b7e-4482-9f54-b0f3dc75061f service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:30.938196 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-4f31a204-4868-496e-a448-501dd9329a72 req-ebad84dc-5b7e-4482-9f54-b0f3dc75061f service nova] Creating event network-vif-deleted:b172f3f7-c5de-42d8-bc4e-ed1a26ad41f0 for instance 895f9604-efa8-451b-9d41-b529fc177216 on hv-cinder-83090 May 13 15:12:30.943691 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-4f31a204-4868-496e-a448-501dd9329a72 req-ebad84dc-5b7e-4482-9f54-b0f3dc75061f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032396 May 13 15:12:30.944319 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 594/1169] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:12:31.342908 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-b1cb26b4-a5d7-4a48-8d54-74e749a02543 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:31.343510 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-b1cb26b4-a5d7-4a48-8d54-74e749a02543 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:31.349677 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b1cb26b4-a5d7-4a48-8d54-74e749a02543 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:31.350118 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b1cb26b4-a5d7-4a48-8d54-74e749a02543 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:31.351174 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b1cb26b4-a5d7-4a48-8d54-74e749a02543 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:31.351757 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-b1cb26b4-a5d7-4a48-8d54-74e749a02543 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:31.497346 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-b1cb26b4-a5d7-4a48-8d54-74e749a02543 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:31.504976 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-b1cb26b4-a5d7-4a48-8d54-74e749a02543 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1265 microversion: 2.1 time: 0.166051 May 13 15:12:31.505544 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 576/1170] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:31 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:31.897235 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-0af78bc8-6b56-4c4d-b46e-7c5033e05811 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:31.897930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-0af78bc8-6b56-4c4d-b46e-7c5033e05811 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] [instance: 895f9604-efa8-451b-9d41-b529fc177216] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:31.904857 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0af78bc8-6b56-4c4d-b46e-7c5033e05811 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:31.905307 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0af78bc8-6b56-4c4d-b46e-7c5033e05811 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:31.906086 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0af78bc8-6b56-4c4d-b46e-7c5033e05811 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:31.906521 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0af78bc8-6b56-4c4d-b46e-7c5033e05811 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:31.920488 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-0af78bc8-6b56-4c4d-b46e-7c5033e05811 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] HTTP exception thrown: Instance 895f9604-efa8-451b-9d41-b529fc177216 could not be found. May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-0af78bc8-6b56-4c4d-b46e-7c5033e05811 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Request method failure captured: May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 HTTP/1.1 May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnQYGx4HJbEJyDl66-JUGzD9neBDzeSalzIY6kaq0vmrgx10_NwefFRmQIYKDTHrsNGO4yWMslQbhh0frQzNLtiXAy_u9msEkMAdWxnTQonsrudbZnABo_zrhWFIClPtSiSulV1eHkIea3-oTcIe6agOpJm2NQlJMy-V02tUmcMWOQE May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: e43258e7d75e41f3b8763db3122c86b3 May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-TestShelveInstance-615193884 May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:12:31.922111 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:12:31.923706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_e43258e7d75e41f3b8763db3122c86b3", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e43258e7d75e41f3b8763db3122c86b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e43258e7d75e41f3b8763db3122c86b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/e43258e7d75e41f3b8763db3122c86b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:12:31.923706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-TestShelveInstance-615193884 May 13 15:12:31.923706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: e43258e7d75e41f3b8763db3122c86b3 May 13 15:12:31.923706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-TestShelveInstance-615193884 May 13 15:12:31.923706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-TestShelveInstance-615193884-project May 13 15:12:31.923706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:12:31.923706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:12:31.923706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: 6eb4364f9eb6426581b983a436671b2e May 13 15:12:31.923706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-TestShelveInstance-615193884-project May 13 15:12:31.923706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:12:31.923706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 895f9604-efa8-451b-9d41-b529fc177216 could not be found. May 13 15:12:31.923706 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '895f9604-efa8-451b-9d41-b529fc177216'} May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 895f9604-efa8-451b-9d41-b529fc177216 could not be found. May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:12:31.924892 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 895f9604-efa8-451b-9d41-b529fc177216 could not be found. May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 895f9604-efa8-451b-9d41-b529fc177216 could not be found. May 13 15:12:31.926507 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:12:31.928069 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-0af78bc8-6b56-4c4d-b46e-7c5033e05811 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Returning 404 to user: Instance 895f9604-efa8-451b-9d41-b529fc177216 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:12:31.928069 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-0af78bc8-6b56-4c4d-b46e-7c5033e05811 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216" status: 404 len: 111 microversion: 2.1 time: 0.031095 May 13 15:12:31.928069 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 595/1171] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:31 2022] GET /compute/v2.1/servers/895f9604-efa8-451b-9d41-b529fc177216 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:12:32.042727 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 15:12:32.042910 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Fri May 13 15:12:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 15:12:32.089899 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-65a32c5c-856d-4886-a475-aab32e977357 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] Calling method '.version_select at 0x7fcf482758b0>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:32.117213 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-65a32c5c-856d-4886-a475-aab32e977357 tempest-TestShelveInstance-615193884 tempest-TestShelveInstance-615193884-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1791362010" status: 202 len: 0 microversion: 2.1 time: 0.031644 May 13 15:12:32.119144 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 577/1172] 10.222.0.99 () {58 vars in 1253 bytes} [Fri May 13 15:12:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1791362010 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:12:32.522102 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f7c64e1a-1f3e-4cdc-acd3-2642fc53e339 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:32.522836 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f7c64e1a-1f3e-4cdc-acd3-2642fc53e339 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:32.529392 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f7c64e1a-1f3e-4cdc-acd3-2642fc53e339 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:32.529846 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f7c64e1a-1f3e-4cdc-acd3-2642fc53e339 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:32.530621 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f7c64e1a-1f3e-4cdc-acd3-2642fc53e339 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:32.531061 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f7c64e1a-1f3e-4cdc-acd3-2642fc53e339 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:32.777425 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-f7c64e1a-1f3e-4cdc-acd3-2642fc53e339 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:32.785189 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f7c64e1a-1f3e-4cdc-acd3-2642fc53e339 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1265 microversion: 2.1 time: 0.267118 May 13 15:12:32.785768 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 596/1173] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:32 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:33.802990 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-08550c96-177e-481e-9282-8676734f4c64 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:33.803590 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-08550c96-177e-481e-9282-8676734f4c64 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:33.812099 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-08550c96-177e-481e-9282-8676734f4c64 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:33.812768 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-08550c96-177e-481e-9282-8676734f4c64 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:33.813812 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-08550c96-177e-481e-9282-8676734f4c64 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:33.814256 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-08550c96-177e-481e-9282-8676734f4c64 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:34.059533 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-08550c96-177e-481e-9282-8676734f4c64 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:34.068049 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-08550c96-177e-481e-9282-8676734f4c64 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1265 microversion: 2.1 time: 0.269511 May 13 15:12:34.077943 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 578/1174] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:33 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:35.086459 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-0fafb10a-d5f2-41ca-9797-675234795c07 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:35.087757 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-0fafb10a-d5f2-41ca-9797-675234795c07 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:35.094327 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0fafb10a-d5f2-41ca-9797-675234795c07 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:35.094759 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0fafb10a-d5f2-41ca-9797-675234795c07 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:35.095661 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0fafb10a-d5f2-41ca-9797-675234795c07 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:35.096170 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-0fafb10a-d5f2-41ca-9797-675234795c07 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:35.288600 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-0fafb10a-d5f2-41ca-9797-675234795c07 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:35.298793 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-0fafb10a-d5f2-41ca-9797-675234795c07 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1265 microversion: 2.1 time: 0.216608 May 13 15:12:35.299759 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 597/1175] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:35 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 15:12:35.979097 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [req-497e536b-28a1-48db-bc40-07c7e919e03a req-7e3dc0ea-be7b-46c1-9d8a-9b17e55b3ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0", "name": "network-vif-plugged", "status": "completed", "tag": "611441d5-ddd9-4003-afb3-089dbc1495dc"}]} {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:12:35.989699 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-497e536b-28a1-48db-bc40-07c7e919e03a req-7e3dc0ea-be7b-46c1-9d8a-9b17e55b3ca6 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:35.990331 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [req-497e536b-28a1-48db-bc40-07c7e919e03a req-7e3dc0ea-be7b-46c1-9d8a-9b17e55b3ca6 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:36.001689 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.compute.server_external_events [req-497e536b-28a1-48db-bc40-07c7e919e03a req-7e3dc0ea-be7b-46c1-9d8a-9b17e55b3ca6 service nova] Creating event network-vif-plugged:611441d5-ddd9-4003-afb3-089dbc1495dc for instance 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 on hv-cinder-83090 May 13 15:12:36.006745 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [req-497e536b-28a1-48db-bc40-07c7e919e03a req-7e3dc0ea-be7b-46c1-9d8a-9b17e55b3ca6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096974 May 13 15:12:36.007339 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 579/1176] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:12:36.316670 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-154b0d9e-b1b5-46fd-84f8-c81492a721ec tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:36.318041 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-154b0d9e-b1b5-46fd-84f8-c81492a721ec tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:36.324653 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-154b0d9e-b1b5-46fd-84f8-c81492a721ec tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:36.325113 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-154b0d9e-b1b5-46fd-84f8-c81492a721ec tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:36.325881 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-154b0d9e-b1b5-46fd-84f8-c81492a721ec tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:36.326309 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-154b0d9e-b1b5-46fd-84f8-c81492a721ec tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:36.516817 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-154b0d9e-b1b5-46fd-84f8-c81492a721ec tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:36.525049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-154b0d9e-b1b5-46fd-84f8-c81492a721ec tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1265 microversion: 2.1 time: 0.212476 May 13 15:12:36.525629 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 598/1177] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:36 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:37.547447 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-4821d28f-3c19-404a-a981-0c9dbde01058 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:37.548307 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-4821d28f-3c19-404a-a981-0c9dbde01058 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:37.557537 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4821d28f-3c19-404a-a981-0c9dbde01058 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:37.558132 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4821d28f-3c19-404a-a981-0c9dbde01058 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:37.559035 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4821d28f-3c19-404a-a981-0c9dbde01058 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:37.559581 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-4821d28f-3c19-404a-a981-0c9dbde01058 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:37.734972 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-4821d28f-3c19-404a-a981-0c9dbde01058 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:37.743500 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-4821d28f-3c19-404a-a981-0c9dbde01058 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1265 microversion: 2.1 time: 0.204507 May 13 15:12:37.744188 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 580/1178] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:37 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:38.608248 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 15:12:38.608774 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Fri May 13 15:12:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 15:12:38.765205 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-4f2e0c0c-a074-4f6a-9813-57b7f64a704c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:38.766688 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-4f2e0c0c-a074-4f6a-9813-57b7f64a704c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:38.774991 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4f2e0c0c-a074-4f6a-9813-57b7f64a704c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:38.775730 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4f2e0c0c-a074-4f6a-9813-57b7f64a704c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:38.776773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4f2e0c0c-a074-4f6a-9813-57b7f64a704c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:38.777174 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-4f2e0c0c-a074-4f6a-9813-57b7f64a704c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:38.935801 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-4f2e0c0c-a074-4f6a-9813-57b7f64a704c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:38.943401 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-4f2e0c0c-a074-4f6a-9813-57b7f64a704c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1452 microversion: 2.1 time: 0.184107 May 13 15:12:38.949199 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 599/1179] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:38 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1452 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:38.967366 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-f44f2fa5-1995-4fd2-a8e5-82ac98e96342 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:12:38.969457 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-f44f2fa5-1995-4fd2-a8e5-82ac98e96342 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:12:38.977181 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f44f2fa5-1995-4fd2-a8e5-82ac98e96342 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:38.978084 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f44f2fa5-1995-4fd2-a8e5-82ac98e96342 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:38.980642 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f44f2fa5-1995-4fd2-a8e5-82ac98e96342 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:38.981125 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-f44f2fa5-1995-4fd2-a8e5-82ac98e96342 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:39.144529 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-f44f2fa5-1995-4fd2-a8e5-82ac98e96342 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:12:39.152299 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-f44f2fa5-1995-4fd2-a8e5-82ac98e96342 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1452 microversion: 2.1 time: 0.190375 May 13 15:12:39.153475 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 581/1180] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:12:38 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1452 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:12:41.579499 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-26c6f5d1-ebe3-420b-aad4-f00cdd7289df req-b1188e0f-81be-4e0c-bcdd-c860d61ec093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0", "tag": "611441d5-ddd9-4003-afb3-089dbc1495dc"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:12:41.588693 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-26c6f5d1-ebe3-420b-aad4-f00cdd7289df req-b1188e0f-81be-4e0c-bcdd-c860d61ec093 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:12:41.589138 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-26c6f5d1-ebe3-420b-aad4-f00cdd7289df req-b1188e0f-81be-4e0c-bcdd-c860d61ec093 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:12:41.602212 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-26c6f5d1-ebe3-420b-aad4-f00cdd7289df req-b1188e0f-81be-4e0c-bcdd-c860d61ec093 service nova] Creating event network-changed:611441d5-ddd9-4003-afb3-089dbc1495dc for instance 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 on hv-cinder-83090 May 13 15:12:41.607816 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-26c6f5d1-ebe3-420b-aad4-f00cdd7289df req-b1188e0f-81be-4e0c-bcdd-c860d61ec093 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211736 May 13 15:12:41.608439 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 600/1181] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:14:31.125751 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-d154a4de-a152-461b-805b-663b68969f07 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:14:31.126347 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c7b9bd8a-7848-4e58-b585-7277d1ebf25c] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 13 15:14:31.126745 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-d154a4de-a152-461b-805b-663b68969f07 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:14:31.129988 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-00d9cc80-233f-45a4-adb8-f8c7e6731bc6 req-a252f368-1f77-4b97-8cd0-7cd20828f9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0", "tag": "611441d5-ddd9-4003-afb3-089dbc1495dc"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:14:31.133234 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d154a4de-a152-461b-805b-663b68969f07 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:31.133684 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d154a4de-a152-461b-805b-663b68969f07 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:31.134526 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d154a4de-a152-461b-805b-663b68969f07 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:31.135139 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-d154a4de-a152-461b-805b-663b68969f07 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:31.138554 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-00d9cc80-233f-45a4-adb8-f8c7e6731bc6 req-a252f368-1f77-4b97-8cd0-7cd20828f9b7 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:31.138987 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-00d9cc80-233f-45a4-adb8-f8c7e6731bc6 req-a252f368-1f77-4b97-8cd0-7cd20828f9b7 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:31.150043 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-00d9cc80-233f-45a4-adb8-f8c7e6731bc6 req-a252f368-1f77-4b97-8cd0-7cd20828f9b7 service nova] Creating event network-changed:611441d5-ddd9-4003-afb3-089dbc1495dc for instance 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 on hv-cinder-83090 May 13 15:14:31.164102 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-00d9cc80-233f-45a4-adb8-f8c7e6731bc6 req-a252f368-1f77-4b97-8cd0-7cd20828f9b7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039670 May 13 15:14:31.165143 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 601/1182] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 15:14:31.167384 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-d154a4de-a152-461b-805b-663b68969f07 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Going to try to terminate instance {{(pid=117296) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 15:14:31.261858 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-d154a4de-a152-461b-805b-663b68969f07 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 204 len: 0 microversion: 2.1 time: 0.141273 May 13 15:14:31.262676 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 582/1183] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:14:31 2022] DELETE /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 15:14:31.271819 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-e04028c4-e328-4d3a-8598-08bd6a0dad62 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:14:31.272785 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-e04028c4-e328-4d3a-8598-08bd6a0dad62 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:14:31.279212 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e04028c4-e328-4d3a-8598-08bd6a0dad62 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:31.280001 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e04028c4-e328-4d3a-8598-08bd6a0dad62 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:31.280791 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e04028c4-e328-4d3a-8598-08bd6a0dad62 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:31.281428 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-e04028c4-e328-4d3a-8598-08bd6a0dad62 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:31.529519 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-e04028c4-e328-4d3a-8598-08bd6a0dad62 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:14:31.537933 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-e04028c4-e328-4d3a-8598-08bd6a0dad62 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1577 microversion: 2.1 time: 0.270378 May 13 15:14:31.538482 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 602/1184] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:14:31 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1577 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:14:32.557416 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-e3a9b983-b150-434d-b281-bd196ddc3c3c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:14:32.558118 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-e3a9b983-b150-434d-b281-bd196ddc3c3c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:14:32.564833 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e3a9b983-b150-434d-b281-bd196ddc3c3c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:32.565535 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e3a9b983-b150-434d-b281-bd196ddc3c3c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:32.566326 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e3a9b983-b150-434d-b281-bd196ddc3c3c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:32.566758 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-e3a9b983-b150-434d-b281-bd196ddc3c3c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:32.710771 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-e3a9b983-b150-434d-b281-bd196ddc3c3c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:14:32.719769 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-e3a9b983-b150-434d-b281-bd196ddc3c3c tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1577 microversion: 2.1 time: 0.166834 May 13 15:14:32.720554 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 583/1185] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:14:32 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:14:33.731093 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-84ac036e-be9e-403b-a624-4302c04802b8 req-ce42c49c-bc71-4e67-8e5d-5b336d854be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0", "name": "network-vif-deleted", "tag": "611441d5-ddd9-4003-afb3-089dbc1495dc"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:14:33.739029 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-c43ba8d2-2790-481c-89cb-a2176bf5c953 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:14:33.740270 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-c43ba8d2-2790-481c-89cb-a2176bf5c953 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:14:33.741912 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-84ac036e-be9e-403b-a624-4302c04802b8 req-ce42c49c-bc71-4e67-8e5d-5b336d854be3 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:33.742396 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-84ac036e-be9e-403b-a624-4302c04802b8 req-ce42c49c-bc71-4e67-8e5d-5b336d854be3 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:33.746893 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c43ba8d2-2790-481c-89cb-a2176bf5c953 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:33.747584 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c43ba8d2-2790-481c-89cb-a2176bf5c953 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:33.748573 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c43ba8d2-2790-481c-89cb-a2176bf5c953 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:33.748999 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-c43ba8d2-2790-481c-89cb-a2176bf5c953 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:33.755667 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-84ac036e-be9e-403b-a624-4302c04802b8 req-ce42c49c-bc71-4e67-8e5d-5b336d854be3 service nova] Creating event network-vif-deleted:611441d5-ddd9-4003-afb3-089dbc1495dc for instance 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 on hv-cinder-83090 May 13 15:14:33.759360 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO oslo.messaging._drivers.impl_rabbit [-] [c7b9bd8a-7848-4e58-b585-7277d1ebf25c] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 36078. May 13 15:14:33.761621 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-84ac036e-be9e-403b-a624-4302c04802b8 req-ce42c49c-bc71-4e67-8e5d-5b336d854be3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034606 May 13 15:14:33.762427 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 603/1186] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:14:33.814724 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-c43ba8d2-2790-481c-89cb-a2176bf5c953 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:14:33.822251 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-c43ba8d2-2790-481c-89cb-a2176bf5c953 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 200 len: 1390 microversion: 2.1 time: 0.088115 May 13 15:14:33.822795 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 584/1187] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:14:33 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:14:34.840632 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-24efbf0c-07f0-4c52-93f9-309d3e0f2c23 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:14:34.841232 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-24efbf0c-07f0-4c52-93f9-309d3e0f2c23 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:14:34.848106 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-24efbf0c-07f0-4c52-93f9-309d3e0f2c23 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:34.848551 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-24efbf0c-07f0-4c52-93f9-309d3e0f2c23 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:34.849323 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-24efbf0c-07f0-4c52-93f9-309d3e0f2c23 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:34.849751 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-24efbf0c-07f0-4c52-93f9-309d3e0f2c23 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:34.863360 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-24efbf0c-07f0-4c52-93f9-309d3e0f2c23 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] HTTP exception thrown: Instance 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 could not be found. May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-24efbf0c-07f0-4c52-93f9-309d3e0f2c23 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Request method failure captured: May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 HTTP/1.1 May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnPc7Z5jhMyDbj665qYKH3rXnG9ut-LCnu8vbhCVeTxs4katkuysQ3Ei1izp_YqX7IOv4eU0dDdfmPRnHfprKUzQ81g8-vyoF-AQqtr_s5bIXk8Lfdkj0smAgMS4IMrGrkr4lfBQqnBn9qL6xWUZaTUYQtB7sdTFTRgl8x0tRvItr0k May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 76d2cdfd3aac43e3bb71ae6dda71da82 May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-TestVolumeBootPattern-1878783554 May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:14:34.865049 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:14:34.866842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_76d2cdfd3aac43e3bb71ae6dda71da82", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/76d2cdfd3aac43e3bb71ae6dda71da82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/76d2cdfd3aac43e3bb71ae6dda71da82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/76d2cdfd3aac43e3bb71ae6dda71da82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:14:34.866842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-TestVolumeBootPattern-1878783554 May 13 15:14:34.866842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 76d2cdfd3aac43e3bb71ae6dda71da82 May 13 15:14:34.866842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-TestVolumeBootPattern-1878783554 May 13 15:14:34.866842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-TestVolumeBootPattern-1878783554-project May 13 15:14:34.866842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:14:34.866842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:14:34.866842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: f713f767dbf14d10b9100ea52d093d6b May 13 15:14:34.866842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-TestVolumeBootPattern-1878783554-project May 13 15:14:34.866842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:14:34.866842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 could not be found. May 13 15:14:34.866842 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': '5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0'} May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 could not be found. May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:14:34.867847 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 could not be found. May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 could not be found. May 13 15:14:34.869607 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:14:34.871054 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-24efbf0c-07f0-4c52-93f9-309d3e0f2c23 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Returning 404 to user: Instance 5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:14:34.871054 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-24efbf0c-07f0-4c52-93f9-309d3e0f2c23 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0" status: 404 len: 111 microversion: 2.1 time: 0.030734 May 13 15:14:34.871054 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 604/1188] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:14:34 2022] GET /compute/v2.1/servers/5319d67f-fc6b-4de7-ad0e-9fd5a7e5d6b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:14:38.014645 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-987c41db-923a-47f0-b42d-5bedda04eec1 req-944505c3-b692-40b8-891f-de32ce773359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fec7e15e-143e-4e9f-b445-a558aff4daf9", "tag": "996acf21-cc9f-4966-8612-572a736b1a9c"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:14:38.015271 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-958a242b-eda7-40b0-ba94-558080b9cbfd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:14:38.015635 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-958a242b-eda7-40b0-ba94-558080b9cbfd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:14:38.022353 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-958a242b-eda7-40b0-ba94-558080b9cbfd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:38.022813 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-958a242b-eda7-40b0-ba94-558080b9cbfd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:38.022930 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-987c41db-923a-47f0-b42d-5bedda04eec1 req-944505c3-b692-40b8-891f-de32ce773359 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:38.023311 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-987c41db-923a-47f0-b42d-5bedda04eec1 req-944505c3-b692-40b8-891f-de32ce773359 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:38.023598 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-958a242b-eda7-40b0-ba94-558080b9cbfd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:38.024055 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-958a242b-eda7-40b0-ba94-558080b9cbfd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:38.034529 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-987c41db-923a-47f0-b42d-5bedda04eec1 req-944505c3-b692-40b8-891f-de32ce773359 service nova] Creating event network-changed:996acf21-cc9f-4966-8612-572a736b1a9c for instance fec7e15e-143e-4e9f-b445-a558aff4daf9 on hv-cinder-83090 May 13 15:14:38.039681 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-987c41db-923a-47f0-b42d-5bedda04eec1 req-944505c3-b692-40b8-891f-de32ce773359 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028694 May 13 15:14:38.040310 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 605/1189] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:14:38.051008 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-958a242b-eda7-40b0-ba94-558080b9cbfd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Going to try to terminate instance {{(pid=117296) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 15:14:38.131604 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-958a242b-eda7-40b0-ba94-558080b9cbfd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "DELETE /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 204 len: 0 microversion: 2.1 time: 0.122883 May 13 15:14:38.132673 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 585/1190] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:14:38 2022] DELETE /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 15:14:38.142621 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-6251fde7-c08a-4a5f-ba68-106339f80fbd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:14:38.143478 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-6251fde7-c08a-4a5f-ba68-106339f80fbd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:14:38.154045 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6251fde7-c08a-4a5f-ba68-106339f80fbd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:38.154484 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6251fde7-c08a-4a5f-ba68-106339f80fbd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:38.155275 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6251fde7-c08a-4a5f-ba68-106339f80fbd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:38.155731 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-6251fde7-c08a-4a5f-ba68-106339f80fbd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:38.303237 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.policy [None req-6251fde7-c08a-4a5f-ba68-106339f80fbd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117295) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:14:38.311360 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-6251fde7-c08a-4a5f-ba68-106339f80fbd tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1577 microversion: 2.1 time: 0.173636 May 13 15:14:38.311968 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 606/1191] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:14:38 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:14:39.329856 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-59d1f9c5-ea88-4288-90b1-235b307fe1c9 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:14:39.330589 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-59d1f9c5-ea88-4288-90b1-235b307fe1c9 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:14:39.337265 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-59d1f9c5-ea88-4288-90b1-235b307fe1c9 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:39.337742 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-59d1f9c5-ea88-4288-90b1-235b307fe1c9 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:39.338637 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-59d1f9c5-ea88-4288-90b1-235b307fe1c9 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:39.339078 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-59d1f9c5-ea88-4288-90b1-235b307fe1c9 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:39.540557 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-59d1f9c5-ea88-4288-90b1-235b307fe1c9 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:14:39.548420 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-59d1f9c5-ea88-4288-90b1-235b307fe1c9 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1577 microversion: 2.1 time: 0.222827 May 13 15:14:39.549082 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 586/1192] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:14:39 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1577 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:14:40.499229 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [req-3387cc69-ede7-40f3-bf68-a2aa79a808b6 req-ae23f3d3-87dd-4413-b8b7-bbf909b88f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fec7e15e-143e-4e9f-b445-a558aff4daf9", "name": "network-vif-deleted", "tag": "996acf21-cc9f-4966-8612-572a736b1a9c"}]} {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 15:14:40.510629 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-3387cc69-ede7-40f3-bf68-a2aa79a808b6 req-ae23f3d3-87dd-4413-b8b7-bbf909b88f99 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:40.511357 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [req-3387cc69-ede7-40f3-bf68-a2aa79a808b6 req-ae23f3d3-87dd-4413-b8b7-bbf909b88f99 service nova] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:40.523029 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.compute.server_external_events [req-3387cc69-ede7-40f3-bf68-a2aa79a808b6 req-ae23f3d3-87dd-4413-b8b7-bbf909b88f99 service nova] Creating event network-vif-deleted:996acf21-cc9f-4966-8612-572a736b1a9c for instance fec7e15e-143e-4e9f-b445-a558aff4daf9 on hv-cinder-83090 May 13 15:14:40.528483 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [req-3387cc69-ede7-40f3-bf68-a2aa79a808b6 req-ae23f3d3-87dd-4413-b8b7-bbf909b88f99 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032964 May 13 15:14:40.529584 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 607/1193] 10.222.0.99 () {64 vars in 1317 bytes} [Fri May 13 15:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 15:14:40.566412 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-28437781-2393-4e83-9c31-1c9076788c6d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:14:40.567032 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-28437781-2393-4e83-9c31-1c9076788c6d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:14:40.574257 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-28437781-2393-4e83-9c31-1c9076788c6d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:40.575094 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-28437781-2393-4e83-9c31-1c9076788c6d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:40.575894 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-28437781-2393-4e83-9c31-1c9076788c6d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:40.576361 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-28437781-2393-4e83-9c31-1c9076788c6d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:40.638316 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.policy [None req-28437781-2393-4e83-9c31-1c9076788c6d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f713f767dbf14d10b9100ea52d093d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76d2cdfd3aac43e3bb71ae6dda71da82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117296) authorize /opt/stack/nova/nova/policy.py:199}} May 13 15:14:40.646370 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-28437781-2393-4e83-9c31-1c9076788c6d tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 200 len: 1225 microversion: 2.1 time: 0.084234 May 13 15:14:40.646967 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 587/1194] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:14:40 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 15:14:41.668470 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f15366ec-aa36-4e4e-86de-680f6f2d0c22 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:14:41.669220 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f15366ec-aa36-4e4e-86de-680f6f2d0c22 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: fec7e15e-143e-4e9f-b445-a558aff4daf9] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:14:41.676918 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f15366ec-aa36-4e4e-86de-680f6f2d0c22 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:41.677410 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f15366ec-aa36-4e4e-86de-680f6f2d0c22 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:41.678293 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f15366ec-aa36-4e4e-86de-680f6f2d0c22 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:41.678790 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f15366ec-aa36-4e4e-86de-680f6f2d0c22 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:41.693766 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-f15366ec-aa36-4e4e-86de-680f6f2d0c22 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] HTTP exception thrown: Instance fec7e15e-143e-4e9f-b445-a558aff4daf9 could not be found. May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f15366ec-aa36-4e4e-86de-680f6f2d0c22 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Request method failure captured: May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 HTTP/1.1 May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnPc7Z5jhMyDbj665qYKH3rXnG9ut-LCnu8vbhCVeTxs4katkuysQ3Ei1izp_YqX7IOv4eU0dDdfmPRnHfprKUzQ81g8-vyoF-AQqtr_s5bIXk8Lfdkj0smAgMS4IMrGrkr4lfBQqnBn9qL6xWUZaTUYQtB7sdTFTRgl8x0tRvItr0k May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 76d2cdfd3aac43e3bb71ae6dda71da82 May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-TestVolumeBootPattern-1878783554 May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:14:41.695567 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:14:41.697440 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_76d2cdfd3aac43e3bb71ae6dda71da82", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/76d2cdfd3aac43e3bb71ae6dda71da82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/76d2cdfd3aac43e3bb71ae6dda71da82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/76d2cdfd3aac43e3bb71ae6dda71da82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:14:41.697440 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-TestVolumeBootPattern-1878783554 May 13 15:14:41.697440 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 76d2cdfd3aac43e3bb71ae6dda71da82 May 13 15:14:41.697440 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-TestVolumeBootPattern-1878783554 May 13 15:14:41.697440 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-TestVolumeBootPattern-1878783554-project May 13 15:14:41.697440 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:14:41.697440 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:14:41.697440 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: f713f767dbf14d10b9100ea52d093d6b May 13 15:14:41.697440 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-TestVolumeBootPattern-1878783554-project May 13 15:14:41.697440 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:14:41.697440 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance fec7e15e-143e-4e9f-b445-a558aff4daf9 could not be found. May 13 15:14:41.697440 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': 'fec7e15e-143e-4e9f-b445-a558aff4daf9'} May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fec7e15e-143e-4e9f-b445-a558aff4daf9 could not be found. May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:14:41.698956 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fec7e15e-143e-4e9f-b445-a558aff4daf9 could not be found. May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fec7e15e-143e-4e9f-b445-a558aff4daf9 could not be found. May 13 15:14:41.701534 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:14:41.703508 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f15366ec-aa36-4e4e-86de-680f6f2d0c22 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Returning 404 to user: Instance fec7e15e-143e-4e9f-b445-a558aff4daf9 could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:14:41.703508 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f15366ec-aa36-4e4e-86de-680f6f2d0c22 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9" status: 404 len: 111 microversion: 2.1 time: 0.035654 May 13 15:14:41.703508 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 608/1195] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:14:41 2022] GET /compute/v2.1/servers/fec7e15e-143e-4e9f-b445-a558aff4daf9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:14:42.190088 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3738f0ef-629d-4f37-89b8-0278b6ead724 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:14:42.190692 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.compute.api [None req-3738f0ef-629d-4f37-89b8-0278b6ead724 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117296) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:14:42.197621 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3738f0ef-629d-4f37-89b8-0278b6ead724 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:42.198072 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3738f0ef-629d-4f37-89b8-0278b6ead724 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:42.198943 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3738f0ef-629d-4f37-89b8-0278b6ead724 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:42.199367 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG oslo_concurrency.lockutils [None req-3738f0ef-629d-4f37-89b8-0278b6ead724 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117296) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:42.212344 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.wsgi [None req-3738f0ef-629d-4f37-89b8-0278b6ead724 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] HTTP exception thrown: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3738f0ef-629d-4f37-89b8-0278b6ead724 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Request method failure captured: May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: request: DELETE /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc HTTP/1.1 May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept: application/json May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Accept-Encoding: identity May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Connection: close May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Length: 0 May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Content-Type: application/json May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Host: 10.222.0.99 May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Openstack-System-Scope: None May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: User-Agent: python-urllib3/1.26.9 May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Auth-Token: gAAAAABifnPc7Z5jhMyDbj665qYKH3rXnG9ut-LCnu8vbhCVeTxs4katkuysQ3Ei1izp_YqX7IOv4eU0dDdfmPRnHfprKUzQ81g8-vyoF-AQqtr_s5bIXk8Lfdkj0smAgMS4IMrGrkr4lfBQqnBn9qL6xWUZaTUYQtB7sdTFTRgl8x0tRvItr0k May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Id: None May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Domain-Name: None May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Identity-Status: Confirmed May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Is-Admin-Project: True May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Id: default May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Domain-Name: Default May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Id: 76d2cdfd3aac43e3bb71ae6dda71da82 May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Project-Name: tempest-TestVolumeBootPattern-1878783554 May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Role: reader,member May 13 15:14:42.213981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Roles: reader,member May 13 15:14:42.215981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_76d2cdfd3aac43e3bb71ae6dda71da82", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/76d2cdfd3aac43e3bb71ae6dda71da82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/76d2cdfd3aac43e3bb71ae6dda71da82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/76d2cdfd3aac43e3bb71ae6dda71da82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:14:42.215981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant: tempest-TestVolumeBootPattern-1878783554 May 13 15:14:42.215981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Id: 76d2cdfd3aac43e3bb71ae6dda71da82 May 13 15:14:42.215981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-Tenant-Name: tempest-TestVolumeBootPattern-1878783554 May 13 15:14:42.215981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User: tempest-TestVolumeBootPattern-1878783554-project May 13 15:14:42.215981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Id: default May 13 15:14:42.215981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Domain-Name: Default May 13 15:14:42.215981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Id: f713f767dbf14d10b9100ea52d093d6b May 13 15:14:42.215981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: X-User-Name: tempest-TestVolumeBootPattern-1878783554-project May 13 15:14:42.215981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: method: > May 13 15:14:42.215981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: exception: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. May 13 15:14:42.215981 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: action_args: {'id': 'aaa23852-8937-4694-a856-8a2485f2ecdc'} May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:14:42.217116 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. May 13 15:14:42.218748 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: ERROR nova.api.openstack.wsgi May 13 15:14:42.220567 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-3738f0ef-629d-4f37-89b8-0278b6ead724 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Returning 404 to user: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. {{(pid=117296) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:14:42.220567 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-3738f0ef-629d-4f37-89b8-0278b6ead724 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "DELETE /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 404 len: 111 microversion: 2.1 time: 0.029922 May 13 15:14:42.220567 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 588/1196] 10.222.0.99 () {58 vars in 1238 bytes} [Fri May 13 15:14:42 2022] DELETE /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:14:42.225833 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f6d70ead-ecbc-4a0b-a639-ee3e3adc96c0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '>' {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:14:42.226447 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.compute.api [None req-f6d70ead-ecbc-4a0b-a639-ee3e3adc96c0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] [instance: aaa23852-8937-4694-a856-8a2485f2ecdc] Fetching instance by UUID {{(pid=117295) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 15:14:42.232470 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f6d70ead-ecbc-4a0b-a639-ee3e3adc96c0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:42.232888 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f6d70ead-ecbc-4a0b-a639-ee3e3adc96c0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:42.233658 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f6d70ead-ecbc-4a0b-a639-ee3e3adc96c0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 15:14:42.234117 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG oslo_concurrency.lockutils [None req-f6d70ead-ecbc-4a0b-a639-ee3e3adc96c0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Lock "0f561f54-7711-4fce-bd48-81b057a05d37" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117295) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 15:14:42.247705 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.wsgi [None req-f6d70ead-ecbc-4a0b-a639-ee3e3adc96c0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] HTTP exception thrown: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f6d70ead-ecbc-4a0b-a639-ee3e3adc96c0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Request method failure captured: May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: request: GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc HTTP/1.1 May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept: application/json May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Accept-Encoding: identity May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Connection: close May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Length: 0 May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Content-Type: application/json May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Host: 10.222.0.99 May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Openstack-System-Scope: None May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: User-Agent: python-urllib3/1.26.9 May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Auth-Token: gAAAAABifnPc7Z5jhMyDbj665qYKH3rXnG9ut-LCnu8vbhCVeTxs4katkuysQ3Ei1izp_YqX7IOv4eU0dDdfmPRnHfprKUzQ81g8-vyoF-AQqtr_s5bIXk8Lfdkj0smAgMS4IMrGrkr4lfBQqnBn9qL6xWUZaTUYQtB7sdTFTRgl8x0tRvItr0k May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Id: None May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Domain-Name: None May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Identity-Status: Confirmed May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Is-Admin-Project: True May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Id: default May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Domain-Name: Default May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Id: 76d2cdfd3aac43e3bb71ae6dda71da82 May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Project-Name: tempest-TestVolumeBootPattern-1878783554 May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Role: reader,member May 13 15:14:42.249234 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Roles: reader,member May 13 15:14:42.250878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:8080/v1/AUTH_76d2cdfd3aac43e3bb71ae6dda71da82", "adminURL": "http://10.222.0.99:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/76d2cdfd3aac43e3bb71ae6dda71da82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/76d2cdfd3aac43e3bb71ae6dda71da82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/76d2cdfd3aac43e3bb71ae6dda71da82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}] May 13 15:14:42.250878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant: tempest-TestVolumeBootPattern-1878783554 May 13 15:14:42.250878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Id: 76d2cdfd3aac43e3bb71ae6dda71da82 May 13 15:14:42.250878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-Tenant-Name: tempest-TestVolumeBootPattern-1878783554 May 13 15:14:42.250878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User: tempest-TestVolumeBootPattern-1878783554-project May 13 15:14:42.250878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Id: default May 13 15:14:42.250878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Domain-Name: Default May 13 15:14:42.250878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Id: f713f767dbf14d10b9100ea52d093d6b May 13 15:14:42.250878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: X-User-Name: tempest-TestVolumeBootPattern-1878783554-project May 13 15:14:42.250878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: method: > May 13 15:14:42.250878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: exception: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. May 13 15:14:42.250878 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: action_args: {'id': 'aaa23852-8937-4694-a856-8a2485f2ecdc'} May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: {{(pid=117295) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 15:14:42.251773 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. May 13 15:14:42.253216 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: ERROR nova.api.openstack.wsgi May 13 15:14:42.254452 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: DEBUG nova.api.openstack.wsgi [None req-f6d70ead-ecbc-4a0b-a639-ee3e3adc96c0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Returning 404 to user: Instance aaa23852-8937-4694-a856-8a2485f2ecdc could not be found. {{(pid=117295) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 15:14:42.254452 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO nova.api.openstack.requestlog [None req-f6d70ead-ecbc-4a0b-a639-ee3e3adc96c0 tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc" status: 404 len: 111 microversion: 2.1 time: 0.028664 May 13 15:14:42.254452 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: [pid: 117295|app: 0|req: 609/1197] 10.222.0.99 () {58 vars in 1235 bytes} [Fri May 13 15:14:42 2022] GET /compute/v2.1/servers/aaa23852-8937-4694-a856-8a2485f2ecdc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 15:14:43.562267 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: DEBUG nova.api.openstack.wsgi [None req-dd645776-f87c-4f21-8ac2-e172e78fbd7b tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] Calling method '.version_select at 0x7fcf4846b0d0>' {{(pid=117296) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 15:14:43.582345 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO nova.api.openstack.requestlog [None req-dd645776-f87c-4f21-8ac2-e172e78fbd7b tempest-TestVolumeBootPattern-1878783554 tempest-TestVolumeBootPattern-1878783554-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-472517037" status: 202 len: 0 microversion: 2.1 time: 0.024336 May 13 15:14:43.583153 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: [pid: 117296|app: 0|req: 589/1198] 10.222.0.99 () {58 vars in 1259 bytes} [Fri May 13 15:14:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-472517037 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 15:15:52.052526 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 15:15:52.053475 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Fri May 13 15:15:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 15:15:58.618365 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 15:15:58.619322 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Fri May 13 15:15:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 15:17:26.161129 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 15:17:26.162065 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Fri May 13 15:17:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 15:17:28.692903 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 15:17:28.693531 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Fri May 13 15:17:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 15:17:45.436736 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 15:17:45.437648 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Fri May 13 15:17:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 15:17:54.337753 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 15:17:54.338727 dv-cinder-830901-6-iscsi devstack@n-api.service[117296]: Fri May 13 15:17:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 15:19:12.066551 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 15:19:12.067445 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Fri May 13 15:19:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 15:19:18.630654 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 15:19:18.631389 dv-cinder-830901-6-iscsi devstack@n-api.service[117295]: Fri May 13 15:19:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!